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[57] ABSTRACT 

In a multimedia call center (MMCC) supporting multiple 
channels and forms of communication and storing call 
center transactions in a data repository, a threading software 
application h as a programming i nput for a user to en ter 
association criteria, an access function that accesses at l east 
s tored data in the data repository, a search function that 
searches accessed data f or association criteria, and no tes 
those data entities that meet the assoc iation criteria; and a 
display tuncuon mat display at least indicators of data 
entities meeting the association criteria. The threading ap pli- 
cation serves as a research toll for mining data repositor ies 
ol J trie call center lor inform adon pertinent to busi ness go als 
of the enterprise hosting the call center. UN some embo di- 
ments ihe application is capable of associating transaction s 
occ urring real time as weU as stored data. 
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METHOD AND APPARATUS FOR CREATING 
SPECIALIZED MULTIMEDIA THREADS IN A 
MULTIMEDIA COMMUNICATION CENTER 

CROSS-REFERENCE TO RELATED 
DOCUMENTS 

The present application is a continuation-in-part (CIP) of 
application No. 09/182,937, filed Oct. 29, 1998, now U.S. 
Pat. No. 6,138,139, application Ser. No. 09/183,395, filed 
Oct. 29, 1998, application Ser. No. 09/183,551, filed Oct. 29, 
1998, application Ser. No. 09/182,745 filed Oct. 28, 1998, 
application Ser. No. 09/151,429, filed Sep. 11, 1998 appli- 
cation Ser. No. 09/151,710, filed Sep. 11, 1998 and appli- 
cation Ser. No. 09/151,564 filed Sep. 11, 1998, now U.S. Pat. 
No. 6,108,711, which are incorporated in their entirety by 
reference. 

FIELD OF THE INVENTION 

The present invention is in the field of telecommunication 
encompassing all existing sorts of interaction multimedia 
technology, and pertains more particularly to methods and 
apparatus for creating specialized multimedia-threaded dia- 
logs within a multimedia communication-center. 

BACKGROUND OF THE INVENTION 

In the field of telephony communication, there have been 
many improvements in technology over the years that have 
contributed to more efficient use of telephone communica- 
tion within hosted call-center environments. Most of these 
improvements involve integrating the telephones and 
switching systems in such call centers with computer hard- 
ware and software adapted for, among other things, better 
routing of telephone calls, faster delivery of telephone calls 
and associated information, and improved service with 
regard to client satisfaction. Such computer-enhanced tele- 
phony is known in the art as computer-telephony integration 
(CH). 

Generally speaking, CTI implementations of various 
design and purpose are implemented both within individual 
call-centers and, in some cases, at the telephone network 
level. For example, processors running CTI software appli- 
cations may be linked to telephone switches, service control 
points (SCPs), and network entry points within a public or 
private telephone network. At the call-center level, CTI- 
enhanced processors, data servers, transaction servers, and 
the like, aTe linked to telephone switches and, in some cases, 
to similar CTI hardware at the network level, often by a 
dedicated digital link. CTI processors and other hardware 
within a call-center is commonly referred to as customer 
premises equipment (CPE). It is the CTI processor and 
application software is such centers that provides computer 
enhancement to a call center. 

In a CTl-enhanced call center, telephones at agent stations 
are connected to a central telephony switching apparatus, 
such as an automatic call distributor (ACD) switch or a 
private branch exchange (PBX). The agent stations may also 
be equipped with computer terminals such as personal 
computer/video display unit's (PC/VDU's) so that agents 
manning such stations may have access to stored data as well 
as being linked to incoming callers by telephone equipment. 
Such stations may be interconnected through the PC/VDUs 
by a local area network (LAN). One or more data or 
transaction servers may also be connected to the LAN that 
interconnects agent stations. The LAN is, in turn, typically 
connected to the CTI processor, which is connected to the 
call switching apparatus of the call center. 
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When a call arrives at a call center, whether or not the call 
has been pre-processed at an SCP, typically at least the 
telephone number of the calling line is made available to the 
receiving switch at the call center by the network provider. 

5 This service is available by most networks as caller-ID 
information in one of several formats such as Automatic 
Number Identification (ANI). Typically the number called is 
also available through a service such as Dialed Number 
Identification Service (DNIS). If the call center is computer- 

io enhanced (CTI), the phone number of the calling party may 
be used as a key to access additional information from a 
customer information system (CIS) database at a server on 
the network that connects the agent workstations. In this 
manner information pertinent to a call may be provided to an 

15 agent, often as a screen pop on the agent's PC/VDU, 

In recent years, advances in computer technology, tele- 
phony equipment, and infrastructure have provided many 
opportunities for improving telephone service in publicly- 
switched and private telephone intelligent networks. 

20 Similarly, development of a separate information and data 
network known as the Internet, together with advances in 
computer hardware and software have led to a new multi- 
media telephone system known in the art by several names. 
In this new systemology, telephone calls are simulated by 

25 multimedia computer equipment, and data, such as audio 
data, is transmitted over data networks as data packets. In 
this system the broad term used to describe such computer- 
simulated telephony is Data Network Telephony (DNT). 
For purposes of nomenclature and definition, the inven- 

30 tors wish to distinguish clearly between what might be 
called conventional telephony, which is the telephone ser- 
vice enjoyed by nearly all citizens through local telephone 
companies and several long-distance telephone network 
providers, and what has been described herein as computer- 

35 simulated telephony or data-network telephony. The con- 
ventional systems are referred to herein as Connection- 
Oriented Switched-Telephony (COST) systems, CTI 
enhanced or not. 

^ The computer-simulated, or DNT systems are familiar to 
those who use and understand computers and data-network 
systems. Perhaps the best example of DNT is telephone 
service provided over the Internet, which will be referred to 
herein as Internet Protocol Network Telephony (IPNT), by 

Ae far the most extensive, but still a subset of DNT. 

45 

Both systems use signals transmitted over network finks. 
In fact, connection to data networks for DNT such as IPNT 
is typically accomplished over local telephone lines, used to 
reach points in the network such as an Internet Service 

50 Provider (ISP). The definitive difference is that COST tele- 
phony may be considered to be connection-oriented tele- 
phony. In the COST system, calls are placed and connected 
by a specific dedicated path, and the connection path is 
maintained over the time of the call. Bandwidth is basically 

55 assured. Other calls and data do not share a connected 
channel path in a COST system. A DNT system, on the other 
hand, is not dedicated or connection-oriented. That is, data, 
including audio data, is prepared, sent, and received as data 
packets over a data-network. The data packets share network 

60 links, and may travel by varied and variable paths. 

Recent improvements to available technologies associ- 
ated with the transmission and reception of data packets 
during real-time DNT communication have enabled com- 
panies to successfully add DNT, principally IPNT, capabili- 

65 ties to existing CTI call centers. Such improvements, as 
described herein and known to the inventor, include methods 
for guaranteeing available bandwidth or quality of service 
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(QoS) for a transaction, improved mechanisms for interactions of all multimedia sorts be analyzed, recorded, 

organizing, coding, compressing, and carrying data more and routed according to enterprise (business) rules in a 

efficiently using less bandwidth, and methods and apparatus manner that provides seamless integration between media 

for intelligently replacing lost data via using voice supple- types and application types, thereby allowing agents to 

mentation methods and enhanced buffering capabilities. In 5 respond intelligently and efficiently to customer queries and 

addition to Internet protocol (IPNT) calls, a DNT center may problems. 

also share other forms of media with customers accessing T n addition to identifying and recording communication 

the system through their computers. E-mails, Video mails, center interactions. It is desirable that threaded dialogs of 

fax, file share, file transfer, video calls, and so forth are some suc ^ interactions be created and made available in a contact 

of the other forms of media which may be used. This 10 history for latter review. In systems known to the inventor, 

capability of handling varied media leads to the term mul- sucn dialog threading is practiced and includes a unique 

timedia communications center. A multimedia communica- multimedia capability wherein threaded dialog may be 

tions center may be a combination CTI and DNT center, or cross-referenced to the actual media accounts. The inventor 

may be a DNT center capable of receiving COST calls and knows of no prior art network operating systems wherein 

converting them to a digital DNT format. The term com- 15 multimedia threading is practiced. 

munication center will replace the term call center herein- The multimedia fading capability as practiced in a 

after in this specification when referring to multimedia customer interaction network operating system (CINOS), as 

capabilities. known to the inventor, supports conventional interaction 

In typical communication centers, DNT is accomplished (normal one on one primary dialog) and diverse interaction 

by Internet connection and IPNT calls. For this reason, IPNT 20 ( rclated t fo rd party and mu lti-party dialogs comprising sec- 

and the Internet will be used in examples to follow. IT ondary dialog). These dialogs may be organized and placed 

should be understood, however, that this usage is exemplary, on a cus tomer or issue-specific thread, or an attatched hidden 

and not limiting. thread according to enterprise rules. Hence, any interaction 

In systems known to the inventors, incoming IPNT calls related to a customer or specific transaction or issue may be 

are processed and routed within an IPNT-capable cornrmi- 25 logically stored and recorded. 

nication center in much the same way as COST calls are Reviewing a contact history comprising such identified 

routed in a CTI-enhanced call-center, using similar or iden- and organized dialog threads is vastly more efficient and 

tical routing rules, waiting queues, and so on, aside from the meaningful than is the case with prior art systems that do not 

fact that there are two separate networks involved. Commu- support multimedia or diverse dialog paths. However, since 

nication centers having both CTI and IPNT capability utilize the dialog threads mentioned above are customer or issue 

LAN-connected agent-stations with each station having a specific meaning that only related dialogs and media are 

telephony-switch-connected headset or phone, and a PC associated with the threads, it is still difficult to perform 

connected, in most cases via LAN, to the network carrying man y other types of research that might be useful in a 

the IPNT calls. Therefore, in most cases, IPNT calls are ^ multimedia communication center. For example, it is desir- 

routed to the agent's PC while conventional telephony calls aD i e for an enterprise engaged in selling various computer 

are routed to the agent's conventional telephone or headset. components to track the customer satisfaction level related 

Typically separate lines and equipment must be imple- to the purchase and installation of one particular product 

mented for each type of call weather COST or IPNT. suc h as a particular disk drive. It may be that the disk drive 

Due in part to added costs associated with additional ^ under scrutiny is introductory and success or failure of it's 

equipment, lines, and data ports that are needed to add IPNT popularity will determine future production requirements, 

capability to a CTI-enhanced call-center, companies are It would be desirable under such circumstances to be able 

currently experimenting with various forms of integration to create and review a specialized dialog thread containing 

between the older COST system and the newer IPNT all past and recent dialogs associated with the particular 

system. For example, by enhancing data servers, interactive 45 drive, even if the main theme of such dialogs is unrelated to 

voice response units (IVR's), agent-connecting networks, the disk drive. Such capability exceeds dialog association 

and so on, with the capability of conforming to Internet methods taught with respect to systems known to the inven- 

protocol, call data arriving from either network may be tor and requires further innovation and invention, 

integrated requiring less equipment and lines to facilitate what is cleady nceded ^ a method and apparatus f or 

processing, storage, and transfer of data. 5Q creating specialized dialog threads about a specific pre- 

With many new communication products supporting vari- defined issue or issue set that will link a plurality of 

ous media types available to businesses and customers, a otherwise unrelated dialogs by utilizing previously stored 

communication center must add significant application soft- data and current interaction dialog. Such a capability needs 

ware to accommodate the diversity. For example, e-mail to extend to both stored transaction data and to real-time 

programs have differing parameters than do IP applications. 55 interactions. Such specialized threads or associations may 

IP applications are different regarding protocol than COST aid in research to improve communication center efficiency, 
calls, and so on. Separate routing systems and/or software 

components are needed for routing e-mails, IP calls, COST SUMMARY OF THE INVENTION 

calls, file sharing, etc. Agents must then be trained in the use j n a pr eferred embodim e nt of the present invention, i n a 

of a variety of applications supporting the different types of 60 m'uHjni en'ifl rail roof e r (MMCC) supporting multipiecha n- 

media. n els and forms of communication ana storing call cen ter 

Keeping contact histories, reporting statistics, creating t ransactions in a data repository, jLthread i np software appli- 

routing rules and the like becomes more complex as newer cation is provided, comprising a programming "input for a 

types of media are added to communication center capabil- user to enter association criteria; a n access function th at 

ity. Additional hardware implementations such as servers, 65 accesses at least storea data in me data reposi t ory; a search 

processors, etc. are generally required to aid full multimedia function th at searches accessed da ta for asso cjatiorf^ffjeria^ 

communication and reporting. Therefore, it is desirable that ana notes those data entities that meet the association 
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criteria; and a display function that display at least indicators FIG. U is a process flowchart illustrating logical steps for 
fr f - d ata e ntitles me e lmfl Ihr avAJu.u i ii i n i a Uia\a building an IMA for a user interacting with CINOS accord- 
In a preferred embodiment the display function displays m S to m embodiment of the present invention, 
icons for data entities, the icons arranged in threads or tree FIG. 12 is a block diagram illustrating the relationship 
structures. The icons may be interactive icons that, being 5 between a mass repository, an interaction object model 
selected, invoke and render the data associated with the icon. (IOM interface), and data-interaction systems according to 
Further, the association criteria may comprise individual and an embodiment of the present invention, 
combinations of key words, phrases, text strings, date of FIG. 13 is an exemplary flow chart illustrating interactive 
occurrence, time of occurrence, media type, participant steps associated with IOM functionality according to an 
characteristics, duration of interaction, and participant ini- 10 embodiment of the present invention. 
tiatl0n - FIG. 14 is a Gant table illustrating a pre-defined business 
In some embodiments the access function allows access to process as executed via an interface engine according to an 
stored data and also an ability to monitor transactions embodiment of the present invention, 
occurring in real time. The real time transactions may piQ. 15 is a block diagram illustrating functionality of a 
comprise connection -oriented switched telephony (COST) diverse interaction model according to an embodiment of the 
calls, data network telephony (DNT) calls, including Inter- present invention. 

net Protocol (IP) calls, facsimiles, e-mails, voice mails, and FIG. 16 is a block diagram illustrating functionality of an 

WEB document interactions. exemplary specialized threading model according to an 

The application in embodiments of the invention may 2Q embodiment of the present invention, 
further comprise a programmable alert function that alerts 

one or more of persons associated with the MMCC accord- DESCRIPTION OF THE PREFERRED 

ing to programmed alert criteria. EMBODIMENTS 

In other aspects of the invention methods are taught for FIG. 1 is a multimedia communications center enhanced 

mining data in such a call center, and associating data 25 w ^ a a network operating system according to an embodi- 

according to a broad range of criteria, enabling researchers ment of the present invention. A telephony-network archi- 

and auditors, and the like, to discover interesting and valu- lecture 11 comprises an enterprise -hosted communication 

able facts about a host enterprise and business conducted center 17 that is linked to, in this example, both a publicly - 

that might not otherwise come to light. These and other switched telephone network (PSTN) 13, and a wide area 

aspects of the invention are taught in enabling detail below. 30 network (WAN) 15, which may be the public Internet or 

other digital network, such as a company Intranet. 

BRIEF DESCRIPTION OF THE DRAWING In this particular embodiment communication center 17 

FIGURES handles both conventional telephone calls, which may be 

1 • j- r 1 . . categorized as connection oriented switched telephony 

FIG. 1 is a diagram of a multimedia communications /rn 6 cfn , , . , . , . , mivm F ,/ 

1 a »7t . -1 # j- 35 (COST) calls, and data network telephony (DNT) calls, 

center enhanced with a network operating system according ,. , , „ • : • \ ' , 

tn ^u~a'~*~ tn f ( L _ * • . which may be DNT calls over a private digital network or 

to an embodiment 01 the present invention. -\. * 1 < « • 

calls according to a protocol such as the weli -known Internet 
FIG. 2 is a block diagram illustrating basic layers of a prot ocol. DNT calls are characterized in that data is trans- 
customer interaction operating system according to an miUcd ^ addresscd data packets as opposed to dedicated 
embodiment of the present invention. ^ connect i ons in COST calls. As indicated, PSTN 13 may be 
FIG. 3 is a flow chart illustrating basic steps performed by a private rather than a public network. WAN 15 may be a 
the network operating system of FIG. 2 related to complet- company Intranet, the Internet, or another type of WAN 
ing interactive transactions between business partners. known in the art. The particular method of call delivery and 
FIG. 4 is a block diagram illustrating agent-desktop call center integration is not particularly relevant for the 
function according to an embodiment of the present inven- 45 purposes of this invention. There are many ways known both 
tion. to the inventor as well as known in the art. Particular issues 
FIG. 5 is a block diagram of an exemplary WEB-form discussed in the disclosure between the telephones and the 
customer interface according to an embodiment of the computers might be implemented differently depending on 
present invention. tne actua ^ system, but shall be deemed equivalent for all 

FIG. 6 is a flow chart illustrating media-presentation and 50 P^rew of this invention, 
customer-interface logic steps according to an embodiment Incoming COST calls arrive at a network-level telephony 
of the present invention. switching apparatus 19 in network cloud 13 and are con- 
j-** - . , r . . • nected over trunk 23 to a central telephony switching 
MCj. 7 is an exemplary overview or a multimedia inter- , *- . . \ n J ., U D 
^ J . . apparatus 27 within communication center 17. From switch- 
action storage system within a communication center • *, it n * a a- * • *■ 

A & J . .. _ , . . 55 ing apparatus 27, calls are routed according to existing 

according to an embodiment of the present invention. ' _i • . 1 • • cc * * > ♦ 1^ u ™ 

to v routing rules over internal wiring 56 to agents telephones 

FIG. 8 is a block diagram of the repository of FIG. 7 47^ 49, 5^ arjd 53 res iding at agents' workstations 31, 33, 

illustrating threaded text-blocks and their relationship to 35^ an d 37 respectively. 

stored multimedia according to an embodiment of the Incoming DNT calls, and other communication events 

present invention. 60 &uch ^ e _ mai ^ file transfers and the like, arrive at a routing 

FIG. 9 is a process flow chart illustrating logical steps no de 21 in WAN 15 and are passed on over digital connec- 

taken when building a threaded multimedia contact-history tion 25 to a routing server 29 within communication center 

of communication-center interactions according to an 17. Once calls arrive at server 29, they may, in some 

embodiment of the present invention. embodiments, be routed directly over LAN 55 according to 

FIG. 10 is a block diagram illustrating an interactive 65 existing routing rules to personal computer/video display 

multimedia application (IMA) tool kit and a created appli- units (PC/VDU) such as PC/VDU 39, 41, 43, or 45 located 

cation according to an embodiment of the present invention. at agent's workstations 31, 33, 35, and 37 respectively. 
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In this embodiment, switch- con nected telephones 47-53 serve all multimedia transactions, and a customer- 
are also connected to PC/VDLPs 39-45 via a headset to information-system server (CIS) 57 adapted to physically 
computer sound-card according to technique known to the store and serve information relevant to customers such as 
inventor and accomplished via an I/O cable. Thus purchase history, financial status, product preferences, con- 
connected, agents may respond to incoming COST and DNT 5 tact information, etc. A central server (COS) 77 acts as a host 
calls with the same headset. location for a CINOS manager application (noted in text 

j « . . . . .. . balloon) which is, in effect, the parent application that 

In the exemplary system and communication center controls a U of the operation and functionality of tbe system, 

shown, the equipment and applications are adapted to pro- T ..... . .f , , ' . j . 

-j r . . • • • , , £(U . * I n add ition to the above-mentioned machines hosting 

vide for multimedia operation at each of the agent stations CI NUS routines, each KJVDU such as PUVDU 39, for 

so the agents can interact with clients m many different 10 e x Mple> ha s a e tWOS ^ jel^sg top interlace or clie nt 

ways, as are known in the multimedia arts. ar gjcjfcn (n 5Tsr5w5 ^d a pte«f to interact with T he par ent 

Computer telephony integration (CTI) enhancement is, in dgpcition Al^o, each machine that provides particular 

this embodiment, provided both at communication center 17 dedicated " function to communication center 17 such as 

and in PSTN 13. For example, in PSTN 13, a processor 61 switch -connected CTI processors, IVR's, and other related 

running instances of a CTI application known as a T-server 15 equipment host instances o£ CINOS applic atio n -p rogram 

(TS) to the inventors, and a statistics server (Stat) is con- interfaces (API's) to e nable seamless integration ol coffe ring 

nected to telephony switch 19 via CTI link 65 . An intelligent parameters and/or' protocols th at are used with^ various 

peripheral 59 of the form of an interactive voice response "pl anned application and me.dia types utilised within m m- 

unit (1VR) is connected to processor 61 via data connection mnqicafinn ranter 17 . Such programs may also co^ esickor 

63. Similar CTI equipment is illustrated within communi- 20 P^a_ai^c^inbi n^tion or hosted by themselves, 

cation center 17. Namely, a processor 67 running instances Additionally for performance pu rposes addition al dedi- 

ofTS and Stat and connected to telephony switch 27 via CTI cated network links may exist between tnose servers, but 

link 71, and an IVR 69 connected to processor 67 via a data ^fally they are only performance boosters and hence 

connection 73, with processor 67 further connected to a local J2L S^ purposes , MlY « wmpk network is shown 

area network (LAN) 55 within communication center 17. 25 ^ Piously described, CINOS comprises a multi-tiered 

. , , , ™, architecture. This unique architecture composes an external 

In alternative embodiments there may also be a CTI media layer for interfacing ^ the custom er or business 

processor 22 in WAN 15 connected to server 21 by a CTI contact, a workflow layer for making routing decisions, 

link 24. Also in some embodiments a separate data network organizing automated responses, recording transactions, and 

66 connects these CTI processors. In this way, intelligent 3Q so on, and an interna media later for interfacing and 

routing may be performed at the network level with nego- presenting interactions to an agent or knowledge worker. An 

tiation and direction from within communication center 17, innovative concept associated with CINOS involves the use 

It will be appreciated by those with skill in the art that the of tooled process models, knowledge bases, and other object 

CTI enhancements, as immediately described above, may be models as base instruction for it's various functions. These 

hosted on one processor at PSTN 13 and on one processor 35 modular conventions may be inter-bound with each other, 

at communication center 17 without departing from the and are easily editable providing a customizable framework 

spirit and scope of the present invention. The inventor has that may conform to virtually any existing business logic, 

chosen to show separate processors having separate func- l n simple operation, and after any network level routing, 

tions for exemplary purposes only. It will also be appreciated COST calls and DNT calls including other media events 

by the skilled artisan that there may be many more or fewer ^ arrive at communication center 17 to telephony switch 27, 

than the four agent stations shown in communications center and routing server 29 respectively. Network level routing, as 

17, and hardware and software arrangements may be made defined herein, includes any intelligent implementation that 

is a variety of ways. Also, home agents might be connected ma y be in place and aided via processors 59, 61, and 22. 

in a variety of ways to the call center. Lo ac j balancing to multiple communication centers, and 

In a preferred embodiment of the present invention, a 45 transferring customer data obtained at network-level over 

customer-interaction network operating system, hereinafter data-network connection 66 would be examples of such 

termed (CINOS), is provided for the purpose of managing network-level routing. 

communications center 17, and optimizing and recording all Once a call or other communication event registers at 
agent/customer interactions received at communication cen- either switch 27 or routing server 29, CINOS immediately 
ter 17 from networks 13 and 15. CINOS is unique in the fact 50 identifies the media type associated with the call and begins 
that it is a multi-tiered object-and process-orientated system it's processes depending on enterprise rules. For example, a 
wherein logic regarding the various aspects of it's function- live COST call may first be routed to IVR 69 whereby the 
ality is achieved via knowledge-based architecture and customer can be presented with varying choices such as 
object modeling. Various functions of CINOS, more fully leaving a voice message, waiting in queue, receiving a call 
described below, include capturing (recording), analyzing, 55 back, or perhaps an e-mail, and so on. Interaction by IVR 69, 
routing, and, in many instances, responding via automated in this instance, will preferably be via voice recognition 
process to customers engaged in interactions with the enter- technique such as is known in the art, but may also be via 
prise (company hosting the communication center). CINOS touch tone response or other known method. As previously 
is adapted to support all planned communication mediums described, the caller may elect from a number of options, 
such as multimedia DNT applications including e-mail, 60 such as to hold for a next available agent, select an auto- 
video mail, file transfers, chat sessions, IP calls, and CTI mated response such as a fax back, or perhaps a later 
COST transactions such as voice calls, voice mails, faxes, agent-initiated response such as an e-mail or call back. In all 
and so on. cases, CINOS seamlessly processes and executes the logic 
Referring back to FIG. 1, CINOS utilizes various LAN- required to accomplish the goal of the caller in a media and 
connected machines in order to perform various operations. 65 application-independent fashion. 

Among these various hardware implementations are a mul- DNT events are handled much the same way as described 

timedia server (MIS) 79 adapted to physically store and above for live callers. For example, an IP call may be routed 
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to a digital equivalent of an I VR for interaction or queued for 
a next available agent, and so on. In one embodiment, IVR 
69 may be adapted to handle both COST and DNT interac- 
tion. 

All interactions with live external media, including actual 5 
text-based events whether live or not, are recorded and 
stored in MIS 79 with an associated text version of the media 
stored as well, and becoming part of an overall threaded 
contact history. This is accomplished in varying ways 
according to existing parameters such as media type, 10 
whether the event is a live call, and so on. For example, 
CINOS may execute a command directing IVR 69 to 
digitally record an incoming COST call during customer 
interaction and then store the voice recording of the trans- 
action in MIS 79. A text version of the recording either 15 
created simultaneously from the voice recording via voice- 
to-text techniques (known in the art), or created by a live 
attendant via manual annotation may be sent to and stored in 
DB 79. An IPNT call arriving at routing server 29 may be 
similarly recorded and stored in MIS 79 with an associated 20 
text version of the interaction stored in DB 79. E-mails, 
video calls, voice mails and so on are similarly handled. For 
example, an incoming e-mail is stored in MIS server 79 
while text from the e-mail may be extracted and stored 
associated with the e-mail. 25 

The purpose of the text version of the event is twofold. 
Firstly, a complete text-based transaction history of com- 
munication center 17 may be compiled and reserved for later 
access and audit. Secondly, an agent or knowledge worker 
may, in some instances, see the text version of the event at 30 
the same time that he receives routed notification of the 
event. In this way, an agent may begin mental preparation 
before taking a call. The text version of an event must be 
machine-readable and human readable at times displayed. 
Interactive media-independent viewers, part of the agent's 35 
client application, may be used to disseminate information 
which may initially not be human readable. 

It is important to note here that the text -based version of 
an event may or may not be a complete and verbatim ^ 
rendition of an actual media event. For example, an e-mail 
may contain many documents each having many pages of 
text. Therefore, the text-based version of a particular e-mail 
event may simply contain the name and particulars regard- 
ing the author, a purchase order, and a list of the enclosed 45 
documents by title, and basic content or memo as well as a 
possible manual annotation. The attachments to the e-mail 
may be stored separately, and be also cross-indexed and 
retrievable. Seeing the purchase order when the event is 
routed to an agent desktop tells the agent that this e-mail is 5Q 
important. 

A fax, stored originally as a bit-mapped document, may 
be converted to text in the system via optical recognition 
(OCR) technique wherein sometimes only certain content 
such as the authors contact information, basic intent of the 55 
fax, and perhaps special numbers or codes contained in the 
original fax are recorded in a text version 79, sometimes the 
whole text is OCR'd, while the original fax is stored in it's 
entirety in DB 79. Such codes or numbers that are specifi- 
cally parsed from actual media may be part of a unique 60 
coding system set up by the enterprise whereby customers 
are directed to include such codes or numbers with their 
orders, service requests, and so on. 

Parsing text messages is accomplished via a text-analyzer 
known to the inventor. In other non-text media types, such 65 
as video or graphics, descriptive notes may be taken via live 
attendant and stored in DB 79 as previously mentioned. 
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Voice recognition technology may also be used in a case of 
recorded sound or video with sound. All transactions regard- 
less of media type are thus recorded and stored according to 
enterprise rules with at least a meaningful part of the content 
if not all of the content of such transactions converted to text 
and stored in DB 79 associated with the recording of the 
event. Again, the importance of the text version is that the 
extracted knowledge of the transaction therein is in 
machine-operable code, allowing search and cross- 
referencing functions that may otherwise not be possible. 

After incoming events are analyzed and processed with 
regards to queuing, recording, storing, etc. CINOS decides 
the disposition paths of each event. For example, live calls 
in queue are routed to live agents if available, if this is the 
priority action in the enterprise rules. E-mails are either 
routed to next available agents using a push technology, or 
simply stored in MIS server 79 where they may be retrieved 
by agents after receiving notification. Recorded events such 
as IVR voice requests are stored in MIS server 79 where 
they may be retrieved by agents, and so on. 

By the use of routing and routing notification events, any 
media may be routed to an appropriate agent based on skill, 
or any other rule-based routing method over LAN 55. Actual 
multimedia events may be accessed from MIS server 79 at 
the agent's discretion, or by rule, and text-based versions of 
those events stored in DB 79 may be mirrored and routed to 
the agent along with notification of the incoming event. 

Other services may be performed by CINOS such as 
responding to media requests without agent participation via 
initiating automated fax responses, out-bound dialing cam- 
paigns wherein recorded information is given to a customer 
perhaps concerning an order placed by the customer, and so 
on. Networking via business or chat applications between 
several business partners, customers, agents, and so on, is 
possible wherein each entry may be stored in DB 79 as part 
of a discussion thread including responses of another media 
type, perhaps initiated by a communication-center agent to 
one of the participants during the discussion. 

As a general rule, full multimedia storage is done in a 
mass storage server, and linked by cross-indexing to the 
database. Depending on the business model, full text or only 
partial annotation is stored in the database, or a mix therof, 
e.g by media type. 

In addition to supporting a wide variety of applications 
and protocol, CINOS is provided with the tools for building 
media-independent self-help wizards that are adapted for 
problem solving and reduction. Similarly, external and inter- 
nal interaction media viewers are provided and adapted to 
support any media of choice. 

CINOS uses object modeling and linking techniques that 
are known in the art to effect much of it's goal of presenting 
a seamless customer interaction with an enterprise agent or 
knowledge worker operating in a communication center 
such as center 17. For example, an interaction object model 
(IOM) represents a transcript of all interaction history stored 
in DB 79 and provides an audit trail of the state of trans- 
actions of all interactions. An interaction process model 
(IPM) controls how events are handled within the operating 
system. 

An additional set of models handle how agents receive 
their routed media such as via traditional push model, 
blended push model, publish and subscribe model, or inter- 
rupt model. Prioritizing interaction events may also be 
accomplished through varying the push theme or scheme. 
For example, traditional push technology for e-mail means 
that only e-mail (media type) is being worked on by an 
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agent. By blending the push model with a publish and textual analysis, voice analysis, 1VR interaction, recording 
subscribe model, the interrupt model is created wherein the and storing takes place. A next category is context resolution 
agent may subscribe to various routed media such as answer- 91. Context resolution involves customer identification, 
ing phones, and responding to faxes, but may be interrupted business process binding, preparation for routing, and so on. 
for an important interaction of another media type such as 5 a third category termed interaction routing 93 comprises 
e-mail and so on. In this way an agent's time may be utilized various processes associated with the presentation of the 
according to enterprise rules within an automated environ- interaction to agents, service persons, knowledge workers, 
menl - business partners, customers and the like, that is, all trans- 
Outbound campaigns may be configured according to action partncrs . Category 93 covers queuing, skill-based 
enterprise rules and media preference using a single rule-set 1Q routi automated treatment, workflow models, and so on. 
knowledge-base. This single set or outbound tools can be T 4 , , . t , - 
used to initiate customer dialog via predictive dialing, e-maH . In eraal ^ la 7 e ' * 7 «J m P nses an agent desktop 
push, automated recorded messages, and so on. mt f rfac * n ° l ^ FIG o j> b * described in more detail 
It will be apparent to those with skill in the art that b u elow ' Both external layer 83 and internal layer 87 contain 
common object modeling (COM) can be used to create e required tools for enabling media and apphcation- 
virtually any type of model for any type of enterprise 15 dependent interfacing such as previously mentioned self- 
situation. It is the intention of the inventor to provide the hel P W12ards > media viewers > m6 other CODtrols as P re " 
applicable control codes known in the art for building scribed via enter P rise re- 
process and object models and enabling the linking and Internal media layer 87 provides an agent with, among 
interaction between the models. As previously described, it otoer options, information about the customer or contact, 
is partly the fact that CINOS uses these various models and 20 information about current or historical business processes, 
knowledge bases to achieve desired interaction that sets it information about current interactions and their relationship 
above current-art systems. The inventor knows of no such to business processes, and a knowledge-base to guide the 
network interfacing operating system that is based on the a g en t or knowledge worker with interaction response and 
above described technology. workflow. An agent a, and agent b, and a knowledge worker 
CINOS may be implemented in a number of different 25 c are shown herein interacting with the system as illustrated 
topologies. For example, CINOS may be implemented as a via bi-directional arrows. The skilled artisan will recognize 
centralized topology with one communication center as these are merel V examples, and there may be many more 
shown here in FIG. 1, a distributed topology wherein a such Persons, and interactions in some instances may be 
single communication center may span multiple physical 3Q routed to machines for response. 

locations, a segmented communication center wherein a It will be apparent to one with skill in the art that the 

single pool of agents services more than one company or multi-tiered architecture of CINOS such as is illustrated 

customer base, or a wide communication network wherein a herein may comprise many more or differing steps or 

plurality of communication centers such as center 17 coop- processes without departing from the spirit and scope of the 

eratively service a common pool of customers or a customer 35 present invention, 

base. Enterprises involved in commerce such as large finan- FIG. 3 is a flow chart illustrating basic steps performed by 
cial institutions hosting many geographically separate com- the interaction operating system of FIG. 2 related to com- 
munication centers may build their entire networking system pleting a transaction between a customer and an agent, 
using CINOS architecture in standardized and distributed wherein the transaction is initiated by the customer. Similar 
fashion. There is no limitation to the type of enterprise that ^ steps may be accomplished in the opposite direction for 
may use CINOS as it may be tooled to accommodate communications initiated by an agent, as the system is 
virtually any network architecture linked to a communica- bi-directional, but the present example will serve to teach the 
tion center having DNT capability. inventive aspects of the system. In step 95, an incoming 
It will also be apparent to one with skill in the art that transaction, such as a live call, an e-mail, etc., is received at 
CINOS routines according to various embodiments of the 45 the appropriate CTT switch (COST) or routing server (DNT) 
present invention may be included and implemented at the in a CINOS communication center such as center 17. In step 
network level without departing from the spirit and scope of 97, customer and media type are identified and interaction 
the present invention such as in processor 61, and IVR 59 in proceeds. 

PSTN 13, or in routing node 21 in WAN 11. All transactions, whether live calls, such as video calls, 

FIG. 2 is a block diagram illustrating basic layers of the 50 DNT calls and COST calls, or text-based documents, such as 

network operating system according to an embodiment of e-mails, are recorded and stored in one or more mass storage 

the present invention. As previously described with refer- devices handled by one or more database applications. This 

ence to FIG. 1, CINOS comprises three basic operating may be taken as server 79 of FIG. 1, although the diagram 

layers. They are an external media layer 83, a workflow of FIG. 1 is exemplary. 

layer 85, and an internal media layer 87. External media 5S A principle object of the invention is to extract maximum 

layer 83 interfaces directly with the customers or business information from every transaction for building a knowledge 

contacts or partners as illustrated via customers a and b, and base that can be used for dynamic management and future 

business contact c. The bi-directional arrows beneath each of analysis and development. This is done primarily by data 

the above mentioned participants illustrate interactive par- mining, which is applicable to machine-operable code, that 

ticipation with CINOS on the customer side. 50 is text. Because of the nature of the extraction, there is a 

External media layer 83 may, in one embodiment, be a difference in the way live calls and text -based media is 

multifaceted, web-based self-help interface providing news handled. 

information and a host of other services that may be per- Discrimination as to the text nature of the me dia is made 

sonalized by the customer. In many respects, external media atstep 99. If the media chosen by the customer is alrea dy 
layer 83 in this embodiment is similar to a web browser, gs jext-based, then the transaction is recorded as received 

Workflow layer 85 comprises 3 basic function categories (101), and a data mining ap plic^a^n^mF^iimpn rtant 

beginning with a content analysis category 89 wherein information in step 103 and stores it in the kniyfarlfl- 
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The distinct portions and versions of the transaction, such as In another embodiment, Server 121 may be a server on a 

the originally recorded version and any extracted data are private network or corporate WAN instead of an Internet 

related to one another and to other knowledge previously server. In a preferred embodiment, however, any number of 

stored, and become part of a threaded interaction history servers on the Internet and/or linked to a WAN other than the 

associated with an ongoing interaction and ultimately of an 5 Internet may communicate with client 119 as it intended to 

overall contact history. support all existing and known communication protocols. 

If the media chosen by the customer is determined in step A windows client 123 is provided to seamlessly integrate 
99 to be a live interaction such as a COST or IPNT call, then existing applications on the agent's PC to network applica- 
the existing knowledge base is accessed at step 107, and the tions and processes. This may be implemented via a desktop 
call is routed to the best fit agent. This may, of course, be 10 tool-kit 125 that contains all of the required controls for 
done in a number of ways, such as an ADC, skill-based building, integrating and customizing the interface, 
routing as known to the inventors, transfer to an IVR for A business-logic layer comprises business object models 
automatic processing, and so on, as may be dictated by 129, hereinafter termed business objects 129, representing 
enterprise rules. If routing is to an agent, customer infor- contacts, interactions, knowledge-bases, events, routing 
mation may be retrieved from CIS server 57 (FIG. 1) and 15 processes, and other system routines. Integration and inter- 
sent to the agent's PC, and appropriate scripts may be action of the various described desktop components with 
provided to guide an agent in interacting with the caller. these logics is accomplished via common object modeling 

In step 109 the actual transaction is recorded as it takes (COM) which is known in the art and available to the 

place, which, in the case of live calls, may be a video or an inventor. Desktop to CTI integration is accomplished via 

audio recording or a combination of both. Preferably the 20 controls provided or created with a CTI set of tools or tool 

recording is digitized. kit (not shown). For example, if the enterprise desires to 

In step 111, a maximal text version is prepared from the blend voice and e-mail, the CTI tool kit would be used to 

actual transaction. The ability to do so depends to a degree build and integrate the interface. 

on the sophistication of the system. This process may be as Existing network applications such as CIS, enterprise 

simple as a person adding notes for annotation or as sophis- 25 resource planning (ERP), Commerce, and the like interact 

ticated as a voice-to-text application preparing a full text with various business objects using COM and may also 

version as the transaction transpires. interact with a physical database using ODBC and SQL. 

In step 113 the text version is mined for data and resulting 
knowledge is stored in the appropriate knowledge base for 3Q 

future use, and added to overall record with appropriate According to a preferred embodiment of the present 

cross-referencing. invention, CINOS access by customers of an enhanced 

It will be apparent to one with skill in the art that there will multimedia communication center, such as center 17 of FIG. 

be many routines comprising various steps for performing h is controlled by means of a customer-facing media 

different processes as may be determined by enterprise rules 35 interface, by which customers may be identified and even 

which may likewise vary depending on, among other categorized according to numerous criteria. In some cases 

considerations, company type, product and or service type, access may be controlled through subscription, or according 

communication center architecture, whether or not the sys- to other qualifying criteria such as may be deemed appro- 

tem architecture is centralized or distributed, and so on. The priate by the enterprise. For example, if the enterprise is an 

embodiment taught herein is meant only as a basic example 4Q exclusive investment club, membership may be required, 

of process functionality related to CINOS processing of an Categorizing criteria may include demographic information 

incoming event. such as income level, credit history, or any other attribute 

FIG. 4 is a block diagram illustrating agent-desktop that ma y be quantified and used to categorize a customer, 

function according to an embodiment of the present inven- An enterprise-controlled access point may be defined as 

tion. An agent-desktop client 115, part of the CINOS overall 45 an interfacing window or portal created and maintained at a 

architecture, enables an agent or knowledge worker to typical customer entry point in a network as may be known 

configure and control his or her interface to the rest of the in the art. Such interfaces may take the form of a WEB- 

system and to external media. Client 115 may be personal- based customer interface (a WEB page), an interactive voice . 

ized according to a particular agents parameters. A desktop response (IVR) unit, a service control point (SCP), or some 

interface 117 may appear and function much like a person- 50 other customer-facing system or apparatus as may be known 

alized web -browser containing many similar attributes in the art. 

related to network capabilities including full multimedia For the purposes of this specification, an example of an 
function, software tool kits, linking and embedding enterprise -controlled WEB-form access and interface win- 
capability, and so on. dow is illustrated as an example for a preferred embodiment. 

An HTML client application 119 oversees all of the 55 The inventor deems such an interface to be most adept in 

network capability previously mentioned. In this embodi- offering best-fit media options while remaining accessible to 

ment for example, HTML client 119 communicates with an a large customer or client base. 

Internet information server 121 using HTTP protocol which FIG. 5 is a block diagram of a WEB-form customer 
is standard. Client 119, if provided minimally, may be used interface according to an embodiment of the present inven- 
in conjunction with an Internet browser for full multimedia 60 tion. WEB form 133, hereinafter termed access window 133, 
function. In some embodiments, it may be maximally pro- is provided to be a part of an enterprise's WEB page which 
vided to be a fully featured client with full web browser may be accessed through Internet connection and 
function. For example, an agent may create and edit web navigation, as is known in the art. Widow 133 is part of the 
forms, web pages, embed controls into such web -based CINOS software architecture described above, and rep re- 
forms or pages to provide certain customer interaction 65 sents the initiation of any customer interaction with the 
mechanisms in addition to having a fully functional navi- hosting enterprise. A WEB counter 143 is provided and 
gation tool at his disposal. records the number of visits to window 133. 
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Window 133 is built and edited using COM codes avail- 
able to the inventor and typically found in tool kits adapted 
for the purpose of creating interactive displays on a WEB 
page. Such a toolkit may be located on an agent's desktop, 
perhaps part of an agent's HTML client such as client 119 
of FIG. 4. In one embodiment, it may be part of a system 
administrator's tool kit. 

Window 133 contains interactive options directed at vari- 
ous categories and functions. For example, a new client 
section 135 contains interactive options related to adding a 
new client to the active customer base of the enterprise. A 
customer service section 137 contains interactive options 
presented to existing clients needing service. A new order 
section 139 contains interactive options presented to existing 
clients wishing to do new business. 

Each offered interactive option is an embedded executable 
function having the appropriate links to other system areas 
of CINOS such as may be relevant to the immediate inter- 
action such as to services offered, routing routines, database 
searching, interaction recording, and so on. 

An innovative function of window 133 is to provide 
front-end control of access to the enterprise by existing and 
potential clients/customers. For example, as a client, contact, 
or potential client interacts with the various media and 
functional options presented by the enterprise in window 
133, he or she is being directed according to enterprise rules 
in such a way that he or she may first be qualified or not to 
patronize the enterprise. Secondly, the contacting person 
may be categorized and sorted as to type of qualified 
customer. Thirdly, the person contacting person may be 
directed to pre-selected media options by the enterprise for 
various services offered including but not limited to routing 
live interactions, and so on. 

In a preferred embodiment of the present invention, 
access window 133 is fully customizable, based on customer 
data and enterprise rules with the focus of such customiza- 
tion directed toward benefiting the enterprise and ultimately 
the client. That is, the client's options within window 133 
are pre-selected and preferred by the hosting enterprise 
based in part on data about the client, details about the 
client's communication equipment and software, and enter- 
prise rules and constraints. In some embodiments, the client 
may aid in customizing window 133. However, as it is 
desired by the enterprise to provide service in a cost- 
effective manner, the client will be presented with options as 
preferred by the enterprise in most cases. 

To further illustrate, refer now to new client section 135. 
If window 133 is part of the enterprise WEB page, as is the 
case with this example, there will be a variety of visitors 
which may or may not be pre -qualified by the enterprise. 
Therefore, an interested party would begin (and be restricted 
to) taking a new client survey, illustrated as one of the 
options in section 135. If the enterprise rules require this as 
a first step, then the other options may be enabled only upon 
completion of the survey. By choosing new client survey, a 
second window may contain various survey options such as 
via e-mail, interactive voice recording, type and send 
method, or the like. 

Information taken in the client survey is recorded and 
entered into a CINOS database such as DB 75 of FIG. 1. 
Such information may also be compared against enterprise 
rules or constraints, and other known information as may be 
available to the enterprise. Assuming the client is now 
recognized by the enterprise, the client's media hardware 
and telephony information may be recorded for future 
interaction purposes. Such information may include the 
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client's personal computer parameters including modem 
type, Internet connection type, computer platform type, type 
of Internet phone application installed, etc. Similarly, COST 
telephone parameters may be recorded, such as personal 
5 phone number, business phone number, cellular phone 
number, forwarding numbers, and so on. Such data will 
influence latter customization of his personal window 133 
for the particular client including the types of media that will 
be offered. 

10 Finally, the client may be asked to create a password for 
the purpose of accessing CINOS. A section 141 is provided 
containing a network log-in option along with download 
sections for obtaining permanent and or temporary software 
as may be desired or needed, or, in some cases, required for 

1 5 the client to access certain services, view certain content, 
and so on. 

Section 137 presents media options for clients seeking 
customer service from the enterprise. These options are, in 
a preferred embodiment, presented in a customized or per- 

20 sonalized fashion within the client's window 133 as was 
described above. , There fore, each client patronizing the 
enterprise may access a version of window 133 that differs 
in look and functionality than that of another client. In this 
example, service section 137 contains options for e-mail, 

25 chat program, fax program, a self-help wizard, and a voice 
wizard. Other media types may be added or subtracted from 
the client's window 133 depending on any of several crite- 
ria. Personalization of widow 133 takes into account client 
information as stored in CINOS database 75, service-agent 

30 media availability and preferences, and perhaps any over- 
riding enterprise rules. Unless and until a client is identified 
there are typically no options presented to the client for 
continuing a transaction with the enterprise. 

35 For an identified client, by selecting the e-mail option, the 
client's preferred e-mail program may be activated for the 
purpose of sending a message to or soliciting a reply from 
a service agent. By selecting chat program, the client may be 
launched into a scheduled service seminar featuring many 

^ clients interacting with a service expert regarding a certain 
subject. One enterprise rule regarding section 137 may be 
that there is no telephone or I-phone media option for 
customer service for a client in the absence of an ongoing 
project with the particular customer. In this sense an ongoing 

45 project includes any unfinished business that the client is 
involved in with the enterprise. 

Self-help wizards and voice wizards as illustrated in 
section 137 may be offered to help a client resolve an issue 
without taxing further resource. Such wizards may be cus- 

50 tomized based on a client's recorded data, perhaps confirm- 
ing past interactions, providing account or order status, and 
so on. In some embodiments, selecting an option might avail 
several additional options. For example, selecting chat pro- 
gram may avail three possible chat programs to choose from 

55 with different schedules, content, and functionality attrib- 
uted to each individual program. 

New order section 139 in this example contains various 
options adapted to facilitate placing orders. The options as 
illustrated herein include, but are not limited to, I-phone, call 

60 back, promotional models, video presentations, an on-line 
viewer, and an order wizard. Interaction is the same as was 
stated with regards to section 137. For example, selecting 
promotional models, accesses a database containing the 
current promotional information and features of products 

65 which may be viewed interactively by the client using an 
on-line viewer offered as one of the functional options (tool). 
The options presented in the New Orders section may also 



11/12/2002, EAST Version: 1.03.0002 



6,167, 

17 

be customized according to client identity, demographics, 
transaction history, and enterprise rules. 

On-line viewers may enable the client to view documents 
that are not supported on his computer platform. Selecting 
video presentation may avail several types of videos for 5 
viewing, such that the client may choose one. If the client 
does not have a viewer installed on his computer which will 
support the offered video, perhaps the on-line viewer may 
play the video, or the client could download a temporary 
viewer from section 141, etc. Selecting call back may bring io 
up a second array of media choices made available by the 
enterprise for receiving a reply interaction from an agent. 

By providing a controlled interface window such as 
window 133 the enterprise may control routing and inter- 
action right from the beginning of customer contact. 15 
Through the innovative method of linking and reporting to 
other CINOS functions, and repositories, much real-time 
personaliation of window 133 according to enterprise rules 
and customer parameters may be made automatically. For 
example, if a client's history indicates a propensity toward 20 
frequent buying, an I -phone option may be presented in 
customer service section 137 in his window 133 immedi- 
ately after such a determination so that he may get direct 
customer service at all times. 

Certain media options, as described above, may be 25 
afforded a certain priority over one another regarding inter- 
action with the enterprise. For example, a VIP client may 
have live interactive media choices offered in window 133 
such as I -phone, call back to COST phone, video phone, etc. 
A client known for infrequent contact or troublesome inter- 
active history may be limited to text-based interaction such 
as e-mail and so on. 

As an integral part of CINOS functionality, window 133 
acts as a portal through which existing and potential clients 35 
may be screened, categorized and routed according to enter- 
prise rules. Customer interfaces such as window 133 may be 
provided at various locations on a WAN such as the Internet 
without departing from the spirit and scope of the present 
invention. Such portals may exist in different geographic 
regions, and may be created for differing customer bases 
such as one for Latin America, and one for the pacific rim, 
and so on. Instances of CINOS routine may be distributed 
widely over a network. 

Although the example provided herein is of a WEB form, 45 
it will be apparent to one with skill in the art that a CTI 
counterpart may be created for the COST telephony net- 
work. Such a case may be a CINOS enhanced IVR at an SCP 
or customer access point in the COST network. 

CINOS, as previously described, optimizes customer/ 50 
agent interaction in a manner which is economical and cost 
efficient to both the enterprise and the patronizing client. The 
customer interfacing window as taught herein with regards 
to FIG. 5 is innovative in that it is a fully customizable portal 
that facilities seamless integration between clients and enter- 55 
prise agents according to enterprise rules. Further innovation 
is evident in that client data is fully and seamlessly inte- 
grated with CINOS intelligence and enterprise rules regard- 
ing routing of interactions and other constraints or limita- 
tions that are programmed into the system. In effect, logic eo 
from the front end, or customer side, to the back end or agent 
side is linked and accessible to all appropriate CINOS 
routines which include applicable CTI CINOS routines. The 
various customer interfacing logic is are explained more 
fully below in a series of process logic steps in a flow chart. 65 

FIG. 6 is a flow chart illustrating media -presentation and 
customer-interface logic steps according to an embodiment 
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of the present invention. In step 145, a visitor registers at an 
enterprise's WEB page. The visitor is identified according to 
enterprise rules in step 147. In step 148 CINOS determines 
the current status of the visitor after searching known client 
and contact data records. For example, the visitor may be a 
potential new client, an existing client, or an existing busi- 
ness contact. Although not specifically illustrated, a potential 
or new-business-client is not typically logically separated 
from a potential new-client until further process ensues in 
step 149 with regards to qualification via survey. 

If the visitor wishes to be a client, he may log-in to the 
network system in step 159. Log-in may be automatic in the 
event that CINOS remembers the client's assigned 
password, or perhaps typing the password or other code may 
still be required for security reasons. At the time of log-in, 
window 133 is presented in personalized fashion according 
to client data and enterprise rules in step 161. In step 163, 
interaction between an enterprise entity and the client begins 
with a media type that is offered by the enterprise and 
selected by the client. An enterprise entity, as immediately 
described above, is herein defined as an agent, knowledge 
worker, service person, or any other five attendant, as well 
as any entity constituting an automated response action such 
as an automated fax, an IVR, automated file downloads, etc. 

At step 148, if it is determined that the visitor is new, then 
a new client survey is conducted in step 149. Step 149 will 
determine if the new visitor is a client or business contact via 
the survey process. As described with reference to FIG. 6, 
the client survey may be conducted using a variety of known 
techniques and media. Presuming that a new visitor qualifies 
as a client or business contact in step 149, he or she may be 
asked to create a password in order to provide access to 
CINOS. In step 153, the client's appropriate communication 
and system parameters are recorded for future reference and 
for use in customizing window 133. 

At step 155, a client instance of CINOS, or perhaps 
another enabling application, may be presented for down- 
load by the client. In some embodiments, there may be no 
required software for download. Therefore, step 155 may be 
considered optional in this regard. In step 157, the new client 
may log-in to the network system and begin interaction. 
Because the client, in this case, is accessing the system for 
the first time, the steps wherein he would obtain a custom- 
ized window and begin interaction with an enterprise entity 
are not shown as intermediate configuration of media 
choices, product preferences, and the like, may still be 
required before a customized interface may be presented. In 
one embodiment, the client may not see a customized 
window until the next time he or she attempts to access the 
network. 

Steps 165, 167, and 169 for an existing business contact 
as determined in step 148 are similar to steps 159, 161, and 
163 for an existing client although the rules for interaction 
such as media used, personnel involved and so forth will be 
different. For example, in step 167 an existing business 
contact may be offered the option of using a network- 
collaboration program wherein I-phone, file sharing, video 
conferencing and the like are inherent to that one applica- 
tion. 

It will be appreciated that there are many possible logic 
sequences or steps that may be followed in interfacing and 
enabling interaction between a client and an enterprise entity 
without departing from the spirit and scope of the present 
invention. FIG. 6 presents just one possible example of 
many. 

It will be apparent to one with skill in the art that the rules 
governing the types of media offered to clients may be based 
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on a combination of variables such as may be decided upon 
by the enterprise without departing from the spirit and scope 
of the present invention. Likewise, offered media types may 
be added or withheld from a client over a period of time 
based on such variables. Moreover, such additions or sub- 
tractions of media availability with regards to customer 
interface window 133 may be automated and based on 
calculated variables. 

In one embodiment, a client may add or subtract media 
choices if desired, however, the enterprise may reserve the 
right not to engage such media if added by a client. 

In one embodiment, special application-independent 
media viewers such as the viewer offered in section 139 of 
window 133 of FIG. 5, are offered to clients and possessed 
by agents so that initial illegible information may be made 
human readable regardless of the authoring application used 
by the agent or the client in the process of interaction. 

Rules-Based Storage and Threading of Multimedia 
Interactions 

In a preferred embodiment of the present invention, all 
CINOS controlled interactions with customers or business 
contacts are recorded and stored in a contact history com- 
prising a MIS database and a text database such as were 
described with reference to copending application P3313PA, 
and described above. That is, actual multimedia interactions 
are recorded to one database or to a section of one database 
supporting all multimedia types used in the communication 
center, and text-based versions are stored in another data- 
base or portion of the same database. All of the actual 
recorded transactions and text versions are related as a 
threaded contact history which may be separate from or part 
of the same database as will be further explained below. 

FIG. 7 is an exemplary overview of a multimedia- 
interaction storage system within a communication center 
according to an embodiment of the present invention. A 
system architecture 171 is illustrated solely for the purpose 
of providing just one of many possible architectures in 
which the methods and apparatus of the invention may be 
practiced. Architecture 171, which in a preferred embodi- 
ment comprises both conventional and DNT apparatus, is 
exemplary of an architecture that could facilitate CINOS 
according to an embodiment of the present invention such as 
is also the case of FIG. 1 

At the heart of the storage system is a mass-storage 
repository 187 adapted to store multimedia interactions as 
well as text-based related files. Repository 187 may utilize 
any form of digital storage technology known in the art such 
as Raid-Array, Optical Storage, and so on. The storage 
capacity of repository 187 will depend directly on it's 
implementation with regard to the size of the communica- 
tion center and predicted amount of data that will be stored 
and kept by the system. 

In this example, repository 187 is divided logically into 
two sections. One section, multimedia information system 
(MIS) 189, is responsible for housing all multimedia inter- 
actions defined as media that is not text-based such as audio, 
video, and graphics-based media. All multimedia interac- 
tions are stored in MIS 189 whether incoming, outgoing, or 
internal. A second section, herein referred to as text section 
191 is responsible for all text-based interactions as well as 
text versions related to non-text files. Sections 191 and 189 
of repository 187 are analogous to MIS 79 and DB 75 of 
FIG. 3. 

Repository 187 is connected to a communication-center 
local area network (LAN) 195. Repository 187 is accessible 
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via LAN 195 to authorized personnel within a communica- 
tion center such as agents, knowledge workers, or the like, 
and may, in some instances, also be made available to clients 
communicating with the call center. A network router (RTN) 

5 175 is shown connected to LAN 195 via network connection 
203. In this example, network router 175 is the first point 
within a communication center wherein DNT media arrives. 
Network router 175 is exemplary of many types of routers 
that may be used to route data over LAN 195. An Internet- 

10 protocol-network-telephony (IPNT) switch 176 is connected 
to network router 175 via data link as is known in the art. 
IPNT switch 176 further routes or distributes live IPNT calls 
that do not require routing to a live agent. IPNT calls that are 
routed to live agents are sent over connection 203 to LAN 

15 195 where they reach agent PC/VDLPs (not shown) or 
DNT-capable phones (not shown) as illustrated via direc- 
tional arrows. 

An object of the present invention is to record all multi- 
media interactions and store them in MIS 189. A further 

20 object of the present invention is to similarly record text 
versions of and text files related to all multimedia interac- 
tions and to store them in text-based section 191. For the 
purpose of the present invention, a text version of a non-text 
file is defined as a sufficient text rendition or description of 

25 a corresponding multimedia interaction. Still another object 
of the present invention is to provide an innovative mecha- 
nism wherein authorized persons may access any particular 
block of text and if desired, call up the actual media to which 
the text relates. 

30 More detail regarding the order and manipulation of 
repository 187 is described further below. 

Creating text-based versions of live multimedia interac- 
tions may, in some cases, be accomplished via an automated 

35 method. For example, a digital voice attendant 197 is 
provided and linked to IPNT switch 176. Digital voice 
attendant 197 may be of the form of a DNT-capable IVR or 
other digital voice-response mechanism as may be known in 
the art. Such automated attendants may interact with a voice 

^ caller instead of requiring a live agent. A speech to text 
converter 199 is provided and linked to voice attendant 197. 
As digital voice attendant 197 interacts with a caller, speech 
to text converter 199 uses voice recognition technology to 
convert the audio speech to text. Such text may then be 

45 stored automatically into text section 191 and related to the 
also-recorded audio data. 

It will be apparent to one with skill in the art that as speech 
recognition technologies are further improved over their 
current state, which is adequate for many implementations, 

50 reliable text versions of audio transactions are not only 
possible but practical. Such speech to text conversions are 
used here only for the convenience of automation wherein 
no live attendant is needed to transcribe such audio data. The 
inventor is familiar with such converters as used in the 

55 CINOS system according to a preferred embodiment. Such 
converters provide convenience in the practice of the present 
invention but are not specifically required to achieve the 
objects of the present invention. 
Manual transcription may also be used to convert audio/ 

60 video to text or code that may then be entered into text 
section 191. For example, a live attendant 201 is shown 
connected to LAN 195, Attendant 201, in this case, may be 
given the responsibility of transcribing audio files from 
speech to text and annotating video or graphics files for the 

65 purpose of creating text files related to the non-text data. 
One or more live attendants such as attendant 201 may be 
provided for this purpose. Some media arriving at a com- 
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munication center such as the one represented via architec- be rendered after the interaction is stored. There is no 

ture 171 will already be text-based and therefore require no limitation regarding sequence. It is sufficient to say that 

conversion or annotation. Short e-mails, Faxes, word converters 185 and 199 are capable of real-time conversion 

documents, and so on are part of this media category. m ^ entry. 

An automated services system 193 is illustrated as having s Server IK shown connected to LAN 195 is adapted to 

a direct connection to section 191 of the data repository. host * CIN0S MGR.(operaUng system) application which 

System 193 is provided for certain text-based interactions, P rov , ldes contro ! f K d °« a ™ c n ^ re 8 ard *° Y™ 

J , j . i- i * * * * f .i functions provided by the CINOS system as a whole. The 

as described above, wherein a complete text record of the . r , .. , J , j « . « ■ 4 , 

. . , - .jj.j storage architecture represented herein by element 171, and 

interaction may be mirrored, or otherwise created and stored aU it en asscs m lhis cmbodime nt, £ meant only t0 bc 

into text section 191. Such automated services may include 10 an example architecture ^ be dedicated t0 me storage 

but are not limited to automated e-mail and fax systems. For md orgariization of communication-center data according to 

example, a fax may be sent and mirrored into section 191 or, enterprise rules. 

perhaps recreated using an optical character recognition A unique method termed mul timedia threading by the 

(OCR) technique and then entered. Physical text-documents inventor is used in a preferred embodiment of the present 

such as legal papers and the like, may be automatically 15 invention for re l a ting each multimedia interaction whether 

scanned into text section 191 before they are sent to clients. incoming to, out going from, or internal to the system, such 

There are many possible automated techniques for entering ^ betwe en an agent and a supervisor. This innovative 

text files into a database. Such methods described with proce ss allows agents or other authorized personnel to 

regards to automated services 193 are a convenience in access text data and ability cross-reference the data to actual 

practicing the present invention but are not specifically 20 recorded multimedia interactions which may be displayed 

required to achieve the objects of the present invention. and pi aved back. 

With respect to the dual capability (COST/DNT) of piG. 8 is an illustration of a relational diagram as might 

architecture 171, a central telephony switch 173 is provided be displayed on a display monitor, representing entities 

to be a first destination for COST calls arriving from, for st0 red in the databases described. The blocks of FIG. 8 

example, a PSTN network. Switch 173 may be a PBX, ACD, illustrate threaded text-blocks and their relationship to stored 

or another known type of telephony switch. Internal COST multimedia according to an embodiment of the present 

wiring 182 connects telephony switch 173 to agent's indi- invention. Repository 187 comprises section 191 and 189 as 

vidual telephones (not shown). Switch 173 is enhanced via illustrated in FIG. 7. Section 191 contains text versions of 

a processor 179 running an instance of T-server and an ^ interactions that are related by such as chronology, issue, 

instance of Stat-server, which are software enhancements participants, company affiliation, and the like. The text 

known to the inventor and have been previously described. documents and versions of non-text files, represented in this 

Such enhancements provide CTI applications, such as intel- case bv icons, are shown related by serial position. For the 

ligent routing, but are not specifically required to practice sa k e 0 f clarity regarding the innovative threading according 

the present invention. CINOS as previously described is t0 ^ embodiment of the present invention, a brief descrip- 

adapted to be integrated with such software when present in tion of prior art threading follows. 

a CINOS enhanced communication-center. Threaded dialog as is known in prior art involves a system 

An intelligent peripheral in the form of a COST IVR 177 0 f strings or threads that are identified as being inherent to 

is provided for the purpose of interacting with callers a single entity or subject matter wherein the dialog 

seeking information and the like who do not require con- ^ (questions and replies) is about that subject or about a 

nection to a live agent. IVR technology may comprise voice question or subject that an entity has brought forth. A 

response, touch tone interaction, or a combination of these threaded dialog may be finite dialog (is closed at some point) 

technologies. IVR 177 is linked to processor 179 and also to or it may be ongoing. Typically, a thread, which connects or 

automated services 193. An example of an IVR interaction associates the pieces of dialog, contains all of the dialog in 

may be the presentation to a caller of options for using an 45 the order that it happened such as in chronological order, 

automated service such as those described above, or perhaps Threading may be implemented based on other criteria as 

waiting for a live agent. may be appropriate for a particular situation or by particular 

A CTI to DNT interface 181 is provided for the purpose rules, 

of converting COST interactions to digital mode compatible As previously described with reference to the background 

with DNT so as to be adapted for digital storage and 50 section, prior art threading techniques are confined to text 

interaction according to CINOS functionality and enterprise such as with an on-line message board or the like. The 

business rules as described above. Interface 181 is not inventor knows of no system that supports full multimedia 

specifically required to practice the present invention so long interaction. The innovative implementation taught below 

as appropriate application programming interfaces (API's) integrates the text-based thread with stored multimedia 

are provided for equipment that interfaces with CINOS. 55 interactions such that one may interact with the thread and 

Bi-directional arrows illustrated between interface 181 and access various stored media associated with the thread. 

IVR 177 represent the ability to route interactions in either Referring again to FIG. 8 f a customer 205 is illustrated as 

direction. COST to DNT conversion may be accomplished having two threads. They are issue I and issue II. Customer 

in IVR 177 in addition to or in place of interface 181. The 205 has an assigned number XX-XX that identifies him or 

connection architecture presented herein is exemplary only. 60 her with respect to the CINOS system. Issues I and II may 

A speech to text converter 185 is provided for converting comprise sales dialog, purchasing dialog, or any other type 

audio from the CTI side to text for entering into text section or purposed dialog as may be generic to the hosting enter- 

191 as was taught with regards to converter 199 on the DNT prise. Customer 205 may well be a business contact, or even 

side. Actual recorded media interactions are illustrated an internal agent practicing dialog with a supervisor or the 

entering MIS 189 after text versions are rendered and 65 like. 

entered into section 191, however, this is not required. In A series of icons a-d represent the type of media stored 

some instances text versions of multimedia interactions may for each text block (text not shown). For example, issue I 



11/12/2002, EAST Version: 1.03.0002 



6,1( 

23 

comprises first an e-mail text followed by a fax text, WEB 
text, and V-phone text. In this case, a time stamp or other 
known method may be used to insure that each text block is 
in order. Icons a-d are interactive pointers or links to the 
actual media interactions that they represent. That is, the first 
block of e-mail text is associated with an interactive icon, in 
this case icon a. By clicking on icon a with a pointer device, 
the actual e-mail may be accessed and viewed. In an 
alternative aspect, not only the actual transaction may be 
presented to a user for review, but related files may also be 
listed or otherwise presented for selection and review. 

A logical link 207 represents cross-referencing capability 
between sections 191 and 189. Dialog may be threaded 
according to a wide variety of business rules. For example, 
a thread or string may represent dialog about a customer, 
product, agent, group of agents, group of customers, and so 
on. An identifier is assigned to an entity and to all the 
communication events to or from that entity, or those in 
which the entity may have been involved such as a group 
discussion or chat. In this way all interactions may be 
organized and stored accordingly. 

In one embodiment, keyboard commands could be used to 
cross-reference to actual media instead of icons. In another 
embodiment, text versions of actual media are fully view- 
able with the text itself appearing in interactive form where- 
upon a double click may call up the associated media and so 
on. There are many variations within the scope of the 
invention. 

Although actual recorded media interactions are, in this 
embodiment, stored in MIS 189, there does not have to be 
two separate databases (one for text and one for actual 
media). All data may reside in one database and be sectioned 
in storage. For example, one click on the customer name 
may bring up text only, while a double click on the text 
brings up the associated media. 

In MIS 189, recorded multimedia interactions are repre- 
sented by icons I-IV and VI. For example element I repre- 
sents all recorded Video phone interactions. Element II 
represents all e-mails. Element III represents all recorded 
COST interactions. Similar associations are made with 
respect to elements IV and VI which represent WEB inter- 
actions and Video mails respectively. WEB interactions IV 
may include on-line orders, requests, information forms, 
signed certificates, and so on. 

Element V represents additional stored multimedia files 
dedicated to, for example, promoting the enterprises prod- 
ucts or services. Promotional files V may contain files of the 
form of any enterprise supported multimedia. These files 
may be tools that can be sent to clients upon request or 
perhaps periodically. 

Referring again to section 191, element b located on the 
thread labeled issue I represents text from a fax. Because a 
fax is text-based and not a multimedia interaction, there is no 
corresponding media event associated with it. However, the 
fax is threaded into the dialog according to, in this case, 
chronological order. A short example of a proposed dialog 
concerning issue I follows. 

Element a represents an e-mail sent by customer 205 to 
the enterprise requesting pricing information. An enterprise 
agent responds with a fax (b) to customer 205 containing the 
requested information. Customer 205 then places an on-line 
order (element c) along with a request for confirmation via 
video phone (element d). Issue I may be closed at this point. 
Issue II may represent a threaded dialog concerning com- 
pany service with regards to the customer order of issue I, 
or perhaps an agent-to-manufacturer dialog regarding how 
the order was handled with respect to issue I. 
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In accordance with CINOS functionality as previously 
taught in descriptions above, data may be mined from 
repository 187 for the purpose of enhancing service to 
customer 205. Mined data may be used to affect routing of 

5 interactions, product promotions or advertisements that may 
be sent to customer 205. In some cases, mined data may 
effect new dialog with a customer or business contact 
resulting in new thread additions. A complete contact history 
with interactive linking to actual recorded media enables the 
enterprise to resolve disputes more easily, better service the 
customer, and enhance profitability for the enterprise. 

FIG. 9 is a process flow chart illustrating logical steps 
taken when building a threaded multimedia contact-history 
of communication-center interactions according to an 
embodiment of the present invention. Logical process steps 

15 as illustrated herein are meant to represent just one of many 
sequences which may be implemented when building a 
multimedia-threaded contact-history. Actual steps will 
depend on enterprise rules. In step 209, a current interaction 
to be recorded is identified. Identifiers may include special 

20 passwords or codes for identifying the contacts involved 
with the interaction. The media type of the interaction is 
identified in step 211. If the media type is already text-based, 
as confirmed in step 213, then the interaction is prepared for 
entry into a database such as section 191 of FIG. 8. Prepa- 

25 ration may include such automated processes as scanning, 
mirroring, file conversions, and so on. Manual annotation 
via live attendants such as attendant 201 of FIG. 7 may also 
be performed. In step 223, the text interaction is entered into 
section 191 of repository 187 and takes it's place along the 

30 associated dialog thread according to enterprise rules. 

If the interaction is of the form of non-text media as 
identified in step 211, then the MIS section of repository 
187, or section 189, is notified to accept the input. At step 
219, the non-text interaction is recorded into section 189 of 

35 repository 187. This may occur in real time as the interaction 
takes place, or some point after the media interaction was 
recorded. 

In step 221, a text version of the recorded media or a 
text-based document related to the transaction is rendered 

40 for storage into section 191 as part of the thread. In some 
instances, as described with reference to FIG. 7, step 221 is 
automated via speech to text converters and occurs at the 
same time or before the recorded multimedia interaction is 
entered into section 189. In other instances, text versions of 

45 multimedia interactions may be rendered after the recorded 
interaction is stored. A five attendant such as attendant 201 
of FIG. 7 may be assigned to parse video and or audio for 
applicable text. Such parsed text is entered into section 191 
and takes it's place along the thread as was described above. 

50 In all cases, an identifying medium is used to assign 
portions of an ongoing dialog to the proper location along a 
thread as well as provide identification to actual recorded 
media for cross-referencing such as may occur during a 
system audit or contact review. Further, the appropriate 

55 icons and or links are created and associated to entered text 
wherein actual multimedia may be cross-referenced in inter- 
active fashion. Hence, the type of media may be readily 
identified by an auditing or reviewing agent simply by 
browsing the threaded text with accessibility to the recorded 

eo events made by interactive method such as clicking an icon 
with a pointer device as was previously described. As an 
additional benefit all of the threaded dialog, whether text 
based or not, is rendered in a form that data mining may be 
used to create many useful relationships and to derive much 

65 useful information from the stored data. 

It will be apparent to one with skill in the art that the order 
and specific function of logical steps as taught herein may 



11/12/2002, EAST Version: 1.03.0002 



6,167,395 

25 26 

vary according to the type of enterprise, existing enterprise limitations and constraints from viewing media that is not 

rules, and so on. For example, instead of threaded dialogs part of their own contact history (for example). Other 

being inherent to a sped fie customer with the dialog being limitations or constraints may also be applied to IMV's 227 

about the customers interactions, it may be specific to a as may be conceived and implemented by a programmer 

particular agent with the dialog about the agents activities. 5 such as playing or viewing interactions of certain dates, 

Such differences in thread assignment may be incorporated playing or viewing interactions about certain subjects, and 

into one rules-based repository. so on. An editable software layer inherent to each viewer 

enables a programmer to build such constraints into a 

Interactive Multimedia Viewers and Applications particular viewer, and to add the edited viewer to an IMA 

In a preferred embodiment of the present invention, 10 Application Program Interfaces (API's) 229 are provided to 

CINOS !*ers comprising such as customers, agents, and aUow a «f to " nd ° btamed data f 01 calculated results to 

business associates are provided with innovative multimedia ™c*d peripheral devices or software modules or appli- 

applications that are containers for dedicated multimedia c c atl ? m as ^ be for ^rations such as prating, 

. U1 . ^-i * a a' * a faxing, sending over a network, etc. It it is desired by 

viewers enabling a particular user to perform a dedicated 6 \ , 6 _ . t 9 , . J 

function or functions including gaining access to and view- 15 enter P rise for * xam P le that a ^tomer be able to print 

ing media from selected areas of CINOS data storage. certain text ° r S ra P hlc *f°™f on obta ™ d th ™S h IMA 

Provision of such applications allows any objective to be * 9 ' men me Wropnate interface may be provided, 
gained regarding virtually any aspect of the enterprise. Database Access Modules (DAM's) 231 are provided for 

These interactive applications are built from a parent appli- allowing access to normally restricted databases that may be 

cation or container that may contain all of the interactive 20 connected to CINOS architecture. Such databases will of 

modules that may be desired to effect a specific application course include multimedia information systems (MIS), cus- 

to be presented to a user having a need for such an tomer information systems (CIS), which may also include 

application contact and agent associated data, external databases such as 

According to various embodiments of the present „ may be hosted by the enterprise, and so on. Cor^traints may 

invention, which are described below, the multimedia appli- 25 be a .PP hed f 10 P ertauu ° g t0 M A * nd 01 wh , al 

cations may be adapted for such tasks as placing orders, P^" 5 of certam databases ma y be accessed b y an ^ 
previewing products, determining customer profitability, 

calculating sales volumes, reviewing agent performances, or Programming language modules 233 are provided and 

any other enterprise-conceived objective. The abilities and 3Q adapted to facilitate the type of platform/system that an IMA 

constraints applied to these unique applications are limited such as IMA 239 will be created for. One IMA such as IMA 

only by the imagination, and tools available to an authorized 239 ma y bc adapted to run on a variety of system types and 

programmer or worker, such as a knowledge worker, who platforms. System platform modules are provided as API's 

creates the applications f° r intended supported system/platform combinations. 

FIG. 10 is a block diagram illustrating an interactive 35 Mathematical function imodul^ (MFM's) are provided and 

multimedia application (IMA) tool kit and a diagram of a ada P ted 10 m,erac ' with CINOS databases for the purpose of 

created IMA application according to an embodiment of the ^ ™' ng P re - selected "lotions ««h as cost averaging 

present invention. An IMA tool kit 225 is provided to an an S0 0tl ' t 
authorized programmer, which may be a knowledge worker, In this particular emb odiment, IMA 23? is a finishe d^ 

for the purpose of creating special multimedia applications 40 a pplication ready to be distributed. IMA 239 contai ns 

such as an IMA 239 (illustrated within tool kit) for users of default display modules (not shown) for the purpose of 

CINOS, wherein users may access and interact with certain enabling computer screen display on a user J s system as is 

pre-selected data for the purpose of reaching decisions and known in the art. IMA may oe stored in a special 

performing certain dedicated objectives as may be defined applications server (not shown) connected to the CIN OS 

by enterprise rules. IMA tool kit 225 contains executable 45 a rtwork either at WAN level or at trie level of tbe h osting 

codes or modules represented as building blocks by the communicatio n center. Tfre method of distribution for 

inventors. These modules may be used by themselves for IMA J s such as IMA239 m ay be of tbe form of a WEB-ba sed 

certain functions, or may be linked to each other to provide client presentation to a user such as in cust omer window 135 

additional function in a programmed order. A good example of FIG. 5, for exampletfIMA239 m ay also be of tbe form of 

of such a module would be a combination of COM codes 50 a browser plufcin accessible via a server such as may beth e 

used to build an interactive graphical interface (module), and c ase with a special applica tions server as described above. In 

the like other instances, such applications may be made a part of an 

Among these functional modules are interactive media agent's desktop and so on. There are many and varied 

viewers (IMV's) 227 which are provided and adapted for possibilities. 

viewing certain media supported by the enterprise hosting a 55 m this particular embodiment, which is exemplary only, 
communication center employing CINOS. Supported media IMA 239 is of the form of an interactive purchase guide for 
types may include but are not limited to telephony oulk P a P er products as illustrated via underlined title. IMA 
(traditional or IP), interactive voice response (IVR), e-mails, 23 9 > in tois example, is logically separated into two distinct 
WEB embedded interfaces or forms, faxes, chat programs, operations or functions. These are operation 241 and opera- 
multiparty threaded discussions, etc. IMV's 227 are unique 60 ^on 243. Operation 241 is a product preview interactive 
in the fact that they are dedicated viewers including an guide, while operation 243 is an order guide. The number of 
interactive layer that enables viewing of only pre-selected operations built in to an IMA such as IMA 239 will depend 
media as defined by enterprise rules. For example, CINOS u P on to e intended purpose of the application according to 
users may be assigned an identification code or number enterprise rules. 

which will also be tagged to all of their stored interactions 65 For exemplary purposes, assume that IMA 239 which is, 

as described elsewhere above with reference to FIG. 9. in this case, a purchase guide for bulk paper products, is to 

These codes may be used to associate individuals with be presented to a corporate buyer who is new on the job. 
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Because he is new, he may be uncomfortable with his own 
knowledge of how much or what kind of paper to buy. His 
predecessor may have a long purchase history with the 
enterprise. Therefore, he requests an IMA such as IMA 239 
that will allow him to preview products, browse the past 5 
purchase history of his predecessor, and perform a calcula- 
tion that averages, by month, the last years paper purchases 
made by his company. 

According to enterprise rules, IMA 239 adheres most 
closely to the buyer's request. That is, It allows for preview 10 
of products (241), and leads the buyer toward an order (243). 
IMA 239 may, in some instances, be designed specifically 
for one buyer if it is determined that his level of business 
contribution warrants it. However, in most cases, IMA 
applications such as application 239 will be more generic 15 
with interchange between different users accomplished with 
some editing performed based upon the intended use of the 
application and user parameters. 

A communication center may provide a number of stan- 
dard IMAs with each IMA adapted to a different objective. 20 
A communication center may also provide custom-built 
MI As for any specific purpose. A certain amount of editing 
ability renders one IMA usable in more than one situation. 

Referring now to IMA 239, as previously described, 
operations 241 (product preview) and operation 243 (order 
guide) are available and related to purchasing bulk paper 
products. Operation 241 begins by presenting two different 
platform options from which a user may select. A platform 
A may be a Windows platform, and a platform B may be a 3Q 
UNIX platform. There may be more or fewer options 
regarding platforms. Similarly, applicable modules such as 
may be generic to a certain platform are installed with each 
platform. In this way, one application may be run on 
differing platforms. 35 

An API , labeled as such, shown logically connecte d 
berieairf platforms A and B is illustrative of an interface for 
linked modules depended on p latform choice. A datab ase 
module (DAM) i5 hrSt logically connected to the~ API 
moume previously described, [th e DAM controls which ^ 
dafaoase or dataoases may be accessed by IMA 239. A 
window shown immediately beneath the DAM provides an 
edit interface wherein the author or programmer may insert 
additional constraints, such as allowing access to only 
certain database sections and so on. 45 

A mathematical function module (MFM) labeled as such 
is shown beneath, and logically connected to the edit win- 
dow. MFM is adapted to allow prescribed mathematical 
operations to be performed relative to database information 
such as cost averaging, grouping by product preference, and 50 
so on. Various modules as have been described herein may 
bring up additional displays on a user's computer if the 
module in question offers a choice of operation or returns 
readable results. Furthermore, standard preview modules 
(not shown) may be presented as object models and invoke 55 
standard viewers such as may be installed on the user's 
computer system. 

An interactive media viewer block (IMV) shown logically 
connected to MFM, allows the user to view pre-selected 
media interactions that are persistently stored in a database 60 
such as MIS 189 of FIG. 7. The IMV block shown may 
represent a plurality of unique IMVs or a single IMV In this 
case three IMVs are involved, and these are represented by 
the blocks labeled TXT (text), VID (video), and AU (audio). 
Each individual IMV has an edit layer wherein a program- 65 
mer may apply limitations or constraints relative to viewing 
capability. In some cases the same limitations may be 
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applied to all the IMVs of an application in one editing 
sequence, such as by doing one edit and copying that edit to 
other IMVs. Although there are three illustrated viewer 
modules that make up the IMV in this example, more or 
fewer viewer modules may be used depending upon the 
intended use of IMA 239 and enterprise rules. 

Although not explicitly shown, each IMV is editable 
through a software layer. In this way, a user may be limited 
to viewing certain media interactions and transactions that 
are allowed via enterprise rules. For example, TXT viewer 
may only be able to view e-mails from the user and agent in 
a specific interaction thread, but not intermittent e-mails on 
the thread that may be from agent to agent or supervisor to 
agent and so on. Because each interactor with CINOS has an 
identification, and all interactions from or to them are so 
identified, these identifiers may be used in the edit layer of 
each viewer to constrain the user. In this way, a user may be 
granted access to a history database and view only his 
interactions without imposing on other users who share the 
system. Likewise, agents or supervisors charged with the 
task of reviewing the activities of certain other agents may 
use applications such as IMA 239, adapted for the stated 
purpose, and be constrained in terms of whose interactions 
(agent's) may be viewed, and so on. In this manner full use 
may be provided to specialized users without exposing 
otherwise sensitive information that is not pertinent to the 
user or the purpose of the IMA. 

Operation 243 created to allow a user to place an order for 
products is, in this case, a logical close for the previous 
operation. A module labeled Media Options may present 
standard media choices that the enterprise accepts for plac- 
ing an order such as IP phone, e-mail, and so on. A connected 
text module (TXT) allows the user to send a quick text order 
while on-line. A send button sends a completed order to the 
enterprise. 

It will be apparent to one with skill in the art that an IMA 
such as IMA 239 may be programmed for virtually any 
enterprise objective without departing from the spirit and 
scope of the present invention, such as those already 
described. By utilizing pre-built modules instead of writing 
codes line-by-line, programmers may greatly increase the 
efficiency of application preparation and presentation to 
users. In many cases only slight editing is required to present 
a new application to a particular user. By using COM, and 
other known conventions such as Java, applications are 
quickly assembled or modified as has been taught herein. 

FIG. 11 is a process flowchart illustrating logical steps for 
building an IMA for a user interacting with CINOS accord- 
ing to an embodiment of the present invention. The process 
described below is meant to be just one example of many 
differing processes that may be implemented when building 
and customizing an IMA such as IMA 239 of FIG. 10. The 
process components and order of which they are assembled 
will depend largely upon the type and purpose of the 
application being assembled and enterprise rules. 

In step 238, the programmer or application author opens 
his tool kit. Such a tool kit may be part of tool kit 125 of FIG. 
4 on a CINOS desktop interface. In step 240, the author sets 
system and platform parameters. That is, he inserts the 
proper functional modules for use of the application on 
specific platforms and or system types. For example, the 
author may set up one application to run on more than one 
platform or system such as IBM and Macintosh. It should be 
noted here that if more than one type of system is supported 
in one application, then the associated modules will need to 
be included as well. 
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In step 242, the author selects a programming language customers, contacts, business associates, products and 

module containing libraries of known programming lan- agents, to accomplish objectives and to effect improvements 

guages and codes. As known in the art, there are different in overall system performance. Such data must be utilized 

programming languages used for different platforms. The very quickly in order to aid in influencing such system 

author, in addition to building with pre-assembled modules, 5 objectives as efficient routing to clients based on client data, 

or building blocks, may have to write certain functional code or ^ another example, generating an updated sales-volume 

in the supported language. In a preferred embodiment, the report based on an entire customcr base's latest transactional 

author has access to these language libraries from within his history Certain CIN0S automatcd systems ^ have to be 

tool kit. able to make decisions in a time frame that would not be 

In step 245, database access rnodule(s) (DAMs) are 1Q sufficicnt to allow physical acceS sin g of actual media, 

selected and inserted. As previously described with refer- a[1 iDnoV ative interface between stored multime- 

ence to FIG. 10 these modules wdl determine which and dia data and various cm0S intelligent systems is provided 

what portions of databases may be accessed. In an alterna- ^ taU g n t below 

tive embodiment these restrictions may also be a part of the . ' „ , . 4 . 1L 

editable layer of IMVs. Step 247 covers mathematical „ . According to a preferred embodiment of the present 

c i . i 4 j j * l u »l ^ 1 c 15 invention, a stored-media mterf ace engine is provided in the 

functions relative to selected databases. Mathematical tunc- „ * . ■ , f^^J\ 

j t rxAT-\x> \ n * f j £ j rorm 01 an interaction obiect model (IOM). Inis unique 

tion modules (MFM s) allow a user to perform pre-defined . , J V, . \ - H „ 

xnrxjr * t_ j j • j\rA convention provides a system-accessible abstract 01 all 

operations. MFMs may or may not be needed in an IMA, , . r . ... , • 

n$_- 4 i_ ui j\ -c l ji 4. j stored interactions within a multimedia com munication cen- 
This step may be omitted rr no such functions are requested 

by a user or otherwise required in an application. 9n 

In step 249, interactive media viewers (IMVs) are created FIG 12 is a block dia g ram instating a relationship 
using viewer modules adapted to view certain media of the betwecn a mass N repository 263, an interaction object model 
type that stored interactions comprise. An IMV is a module P 0M "*=rface) 253, and several data-interaction systems 
that may comprise one or more than one media viewer. Each according to an embodiment of the present mvention. Inter- 
of these viewer modules are editable (via software layer) and « action object model (IOM) 253 functions as a memory- 
may function alone or as a component of a larger module based interface-engine between mass repository 263 and a 
(comprising more than one viewer). vanet y of aN0S data-interaction systems illustrated m this 

In step 251, closing modules are inserted to complete the ™er information system (CIS) 255 audit 

application. For example, order modules are one example of 6m ,< AT SYS > 2S7 > tou ^l S £ l ™ifi? 51? ' lnd 

a closing modules. Modules adapted to return displayed 30 au o ( ma ' ed "™ .SYS) 261 It will beappar- 

results would be another example. Moreover, peripheral cn t0 be ^ "^ 0*1 there may be many different 

device API's may be inserted to allow results to be printed, "}to«ct«JO systems, and the ones illustrated here are exem- 

faxed, sent over the network, etc. In this way, a supervisor P ss ^' 

reviewing the performance of a group of agents may report Repository 263 is analogous to mass repository 187 of 

to other concerned parties such as managers, enterprise 3 5 FIG. 7. It is logically divided into two sections. One section 

board members, or the like. * for dreaded text labeled Text-Based Data, and one is for 

The example as illustrated herein is basic but is deemed multimedia storage labeled MIS Database. All of the corn- 
adequate by the inventor for illustration of one typical IMA nation center s interactions and transactions m this 
building sequence. The description and order of steps may exam P le are P^^ntly stored in repository 263. 
vary considerably. 40 Automated CINOS systems such as systems 255 through 

IMA's such as IMA 239 are transportable over a network 261 are ada P ted to mteract data stored m ^^ry 263 

and may be stored on a special applications server at m order to P erform thelr lntf f ded functions related to 

network level, or within the communication center. In some aN0S operation. For example, CIS 255 uses data in 

embodiments, user's will be connected to the Internet when repository 263 for presenting information to agent s at the 

using IMA's allowing CINOS access. In other 45 time of or ahead of a live interaction. AT SYS 257 has to 

embodiments, agents may access CINOS resources while access aQd P rocess , data for generating system audits. RT 

working off-line with respect to the Internet. In such cases, SYS 25 » ^l™™ data f ° r mtelhgent routing purposes. AS 

logging on to CINOS is stiU required. SYS 261 uses data t0 u P date and c °nfigure services such as 

t. -ii u .< -.u l-ii- .u uL.n/Ai™ faxes, e-mails, voice messaging, and the like. 

It will be apparent to one with skill in the art that IMA239 ' ' ^ =' . 

as taught herein is interactive and displayable on a PC/VDU so IOM 253 is adapted to function as an interface between 

that is logged into CINOS through a WAN. However, this is repository 263 (hard data) and the data interaction systems 

not specifically required to practice the present invention, as descnbed above. IOM 253 is an object model compnsing 

but rather preferred. Other embodiments may include pre- ob jf cls 15 representations of stored files in repository 263, 

senting a CTI interface such as an IVR wherein a user may such . as non ; ,6Xt fi | e f ° f r6Corded transactions. Each object 

interact with the application via voice or touch tone ss making up the model is a representation of one such file. In 

response a preferred embodiment, IOM is a COM-based model with 

In stiU another embodiment, such applications may be w ^ ch othcrQNos COM-based applications may readily 

presented via external media such as on a floppy disk(s) or language conversion interfaces. However, 

CD-ROM wherein a user may, by inserting the disk or CD, m other embodiments, API s may be provided where lap 

obtain the ability of accessing the enterprise via WAN, » g^ge differences are present. M 

gaining access to CINOS, and performing an objective with IOM 253_ ha_s_various capabilities in various embodiments- 

the IMA. which may include, among other functions,, a search f unc- 

tion 265 adap ted to accept parameters as a guide to obt ain 

Stored-Media Interface Engine (Interaction Object r eouested information from IOM memory (element 275 ). 

Model) 65 T here is in this embodiment a data-mining function 267 

An object of the present invention is to allow certain a dapted for minin g hard d ata and converting m intyj flata intn 

CINOS systems to utilize data, such as data about suitable code tor applying to memory objects (represented 
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interactions). A display function 269 is adapted to en able specific data, such as media type, interaction date, partici- 

data results t o be displayed on suitable screen monitors paling party ID's and their parameters, and any parsed 

; "which 'Tnay b e associated with various data interacti on information specific to the interaction and known to be 

systems as previously described. An i^P^u nction 27 1 required by one or more of the automated services. 

provides appropriate interface for unking interaction-d ata 5 Interaction -specific information may include interaction 

systems s uch as systems 255—26 1 to IQM 253. Anj edit purpose or goal, interaction results such as purchase 

tunction provid es editing ability to object parameters by information, resolved issue information, and so on. 

sy stem applications which may, in some instance s be Memory objects, such as objects a-z representing 

a utomated, or. in other instances, manned by admmistr ators interactions, are not only identified with regards to involved 

or k nowledge workers M n object memory 275 is a single file 10 parties as previously described, but may also be identified 

containing all of the objects which represent all of the and associated according to the common thread order of 

communication center's stored interactions. interaction as represented in repository 263, or more 

IOM 253 is run in much the same way as a standard specifically, the text-based portion which is threaded dialog, 
relational object model as is known in the art, except that it It will be apparent to one with skill in the art that an IOM 
is confined to text data and capable of multi-tasking 15 such as IOM 253 may be utilized with databases other than 
(performing multiple simultaneous and unrelated functions) repository 263 without departing from the spirit and scope of 
with respect to multiple system access. Another marked the present invention. For example, IOM 253 may also be 
difference from a standard object model is the data mining used as a system interface to product information databases, 
functionality 267. Id a preferred embodiment, function 267 external knowledge databases, or virtually any other data- 
may be used to add additional data to IOM memory in real 20 base such as may be connected to CINOS or a similar 
time. operating system. 

IOM 253 uses metadata, meaning data about data, in it's FIG. 13 is a flow chart illustrating interactive steps 

abstract representation of hard data files stored in repository associated with IOM functionality according to an embodi- 

263 similar to other data warehousing systems. Such meta- nient of the present invention. The following basic example 

data may be, in some embodiments, compressed in memory 25 of IOM functionality is meant to illustrate just one possible 

for economy in storage. In a case such as that described sequence of logical steps taken when utilizing IOM 253. 

above, a compression and decompression function would be This example should in no way limit the present invention 

added to IOM 253. IOM 253 utilizes memory area 275 for in terms of the broadest scope to which the present invention 

storing metadata objects a-z as illustrated. Metadata objects should be afforded. 

a-z, as illustrated, each represent a single transaction or 30 In step 277, a request to access an IOM such as IOM 253 

interaction file stored in repository 263. Hence, the number of FIG. 12 is received from a data-interaction system such 

of actual objects stored in memory 275 will equal the as RT SYS 259 of FIG. 12. In step 279, the IOM is activated 

number of interactions stored in repository 263, if every t o receive commands related to a dedicated operation or 

stored transaction is shadowed in the IOM. pre-defined process. Activation in this sense is denned as 

IOM 253 is innovative in the fact that it is an object model activation to receive from or communicate with a specific 

interface used as an accessible abstract representation of requesting system. 

hard data files. Therefore, data-interaction systems may In step 281 commands are sent to the IOM for the purpo se 

typically utilize IOM 253 in performing their dedicated o f initiating IOM functions as may be desired. In step 28 3, 

functions without accessing any hard data stored in reposi- ^ th e IOM performs Uie Tfniirslrryjtfn^tirtp nr functions. In 

tory 263. The inventor knows of no system wherein data this case, the function or functions are. adapted to provide 

systems may obtain stored information to aid their dedicated information to be used in routing of a new interaction. A 

functions in the manner and with the apparatus described simple example of a routing-related function would be to 

above, return the information associated with the identified client's 

Memory 275 is typically located in repository 263 as i s 45 last 5 interactions in order to determine a best fit agent to 

the rest of IOM functionality as illustrated via direct ional accept the new interaction. If it is determined that the last 5 

arrows emanatin g from repository 263 and ppinti'n jcr _t o a interactions are leading to a purchase, and the prominent 

sep arate lOM 2^3. Software adapted to comnrmnjcate .with agent involved in the last 5 interactions is identified, then the 

IUM 253 (n ot shoWrmay resiHein^ each ol ^ theLdata - new interaction may be held for that agent in the hopes that 

impaction s ystems z^ z 261^as illustrated v i a direction al 50 statistically, he is more likely to obtain a new order from the 

affbws nnm nnfjjo a pi function 271. , The]* h nve de seribed client. However, if the last 5 interactions are stagnant or 

relationship is not speciricailv required to effect the^gqal o f leading away from a purchase, than the interaction may be 

t hej) resent invention, but ratherpr eferred in it's practice,, routed to a new agent, perhaps with more skill at motivating 

IOM 253 may reside on a separate database that is finked to clients to buy, and so on. 

repository 263. Similarly, API function 271 may contain all S5 In step 285, dis pl ayable results fr om perfor medJ unction s 

of the necessary components for interface with all commu- arereturned to requesting s ystemsTlnsome iDStanresVrefS flts 

nication center data-interaction systems without requiring wTfl not be required to be human readable or to be displa y- 

each system to host software. There are many differing able on a monitor. However in other inst ances, this may b e 

architectural possibilities. r equired sUch as an instance wherein data about a clien t is 

According to an embodiment of the present invention, 60 forwarded to the receiving agent ahead of the clientsi nter- 

IOM 253 is continually updated in real time as interactions action. 

may be stored or deleted in repository 263. Rules-based It will be readily apparent to the skilled artisan that the 
routines determine what type of data will be used in each process steps described above may vary in number and 
meta-data object stored in memory 275. Typically, enterprise description according to type of business, type of data- 
important information such as client ID, client parameters, 65 interaction system requesting information, enterprise rules, 
transactional analysis (such as profitability rating), credit and type of data accessed. This basic example is meant to 
rating, and so forth, will accompany more interaction- provide a broad scope of functionality. 
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Interactive Modules for Managing Business merely deems this particular format to be friendly to a 

Processes programmer building the model and analyzing the returns 

c , , ,. 4 . 4 . . 4 . such as may be displayed on a computer screen. A tool kit 

. In^jEgCggB^ Of tbe preset invention a ^ ft pro / rammer Vth building and fine tuning an IPM 

aultimedia communication center operating CINQS accord- guch ^ TpM 28? Such a ^ ^ may be parl of {h& 

v mg-to previous co-related embodiments is provided, as part pr0 g rainm ers desk-top CINOS application such as perhaps 

o rCINOS, a means to initiate and manage various busin ess tool ^ 125 of F IG. 4, or may reside in and be accessible 

processes related to communicationjyortcllow. s ucITb usi- f rom a ^^j. hosting a CINOS Manager application such as 

ness processes are defined as en terprise-cr eated"applications, server 77 of FIG. 1. 

pr ocedures and so toruXThat are adapted to return ajesult or ^IG. 14 is a GANT chart for a process executable by a 
provide ^so lution re g arding an issue or'reojjest ^iQ^ Dyr CINOS operating system according to an embodiment of the 

cli ent or other entity T present invention. This chart in this embodiment is an 

ATbTiefly described in the background section above, in interactive input and display and editing interface wherein a 

a multimedia communication center it is desired to automate programmer may program a business process having dis- 

business processes where possible and to be able to break 15 crete steps and sub -steps. It will be apparent to the skilled 

down the processes into tasks and sub-tasks that are strictly artisan that such an interface is but one of a number of 

controlled and timed. Prior art network systems require interfaces that would be suitable for the purposes of the 

considerable human intervention while proceeding with a invention, and is meant to illustrate features of the invention, 

business process while, for example, a client waits for a Broadly speaking, by listing steps of a process in this chart 

resolution. Similarly, more time is consumed because actual 2Q along with parameters to be described more fully below, an 

media and hard data may be accessed and processed without application module is created which, by execution, performs 

the benefit of an abstract representation of data (metadata) as the process step by step, and tracks completion of individual 

discussed above relative to an interaction object model tasks, as well as providing reminders when and if allotted 

(IOM). Therefore, an Interactive Process Model (IPM), is completion times are pending or exceeded, and so forth. It 

provided as a generic programmable module, which when will be apparent to the skilled artisan that GANT processes 

complete, represents and conducts a defined business pro- may also be illustrated by flow diagrams (typically PERT 

cess. An IPM according to this invention has ability to obtain charts), and, in a preferred embodiment, the chart depicted 

data from an IOM and to manage business applications in in FIG. 14 may be converted to an editable GANT flow chart 

terms of timing and execution of main tasks and sub-tasks as well. For Example, standard products like MSProject 

that are programmed according to enterprise rules. 3Q Planner may be used to generate a PERT or GANT chart, 

FIG. 14 is a Gant table illustrating a pre-defined business ^ h Y certain labels both for steps and resources, the ArvrU 

process according to an embodiment of the present inven- generated file may directly become an IPM Object. : £ 

tion. A Gant table 287 represents the tasks and sub-tasks of Referring again to FIG. 14, a title row 289 comp rises 

a business procedure, in this case qualifying an exemplary c olumn headers and a li nk to a pop-up editing w i ndow th at 

loan application, as they might appear on a programmers 35 p rovides^ tor entering steps and nejsssajry parameter s. The 

screen after an automated execution sequence has been pt^u^Fwiuaowln-a preferred embodiment has input fields 

completed. Gant table 287 will hereinafter be termed Inter- for entering task numbers, specific action for the task, 

action Process Model (IPM) 287 for the purpose of simpli- sequence and pre-requisites related to other tasks, allotted 

fying explanation. time to complete, and notification parameters, as well as a 

IPM 287 is a programmable interactive engine as previ- 40 Cancel and a Save function. Through the input window a 

ously described. That is, one may program IPM 287 accord- programmer can design and relate all tasks and sub-steps 

ing to various tasks and sub-tasks that may be required for needed for a process. 

the execution of a particular business process. After basic Because IPM 287 is a container for COM objects, task 

programming or set-up, IPM 287 has the capability of objects may also be loaded as required by the programmer 

accessing data from, among other possible sources, the IOM 45 in order to set up the main and sub-tasks inherent to the 

described above, and using that data in the execution of it's process as previously described such as by drag and drop 

intended goal. IPM 287 is innovative in the fact that it begins method as is known in the art. For example, certain objects 

as a generic object model (for example a COM container) in or modules to be inserted are for access to certain data from 

which a programmer may add specific functionality (COM the IOM, while other objects are adapted for accessing 

objects) to create a functional interface engine or model that 50 certain other databases or resources, or for performing 

may execute a timed business procedure according to enter- certain process-related functions. 

prise rules. A variety of notification/command modules may b e 

Although IPM 287 is, in this case, a loan application i nserted into IPM 287 according to j^ibkr esults or sta tes 

process, such an IPM may be programmed to execute that may appear during process execution. The actual m^- 

virtually any conceivable business process that an enterprise 55 u le that will be invoked will depend in part on__ the 

may offer as a wholly or partially automated service to p rogrammer, and in part on the process sequence. Some of 

clients. IPM 287, in this example, is presented as a series of t he windows are retnm windows th at return r esults durin g 

rows and columns comprising entry fields and return fields exe cution of the process. These are w ind ows in the col umns 

in a GANT chart. For example, before the desired function- l abeled" time be^in. time end, and actual timeT" ~~ 

ality is inserted into IPM 287, it is a generic COM model that eo In this embodiment, as a programmer enters new steps 

is adaptable via programming for various business processes and sub-steps in building a new application module, the step 

and resource interface as previously described. It will be numbers with name and generic parameters appear as new 

apparent to those with skill in the art that a COM model and rows. When the last step is entered and configured the 

a GANT form are each simply exemplary of known devices GANT chart is complete, and the process is ready to invoke 

that may be employed in practicing the invention 65 and execute. 

The format of entry and return fields presented herein is A completed chart is editable in the sense that steps and 

not required to practice the present invention. The inventor sub -steps may be altered, added, deleted, and the like, along 
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with names, allotted times, action parameters, and the like. 
A programmer may therefore select an existing application 
module and edit it to save as a new application module. 

When a module is complete the application created may 
be stored and related to other tasks such that the application 5 
may be called whenever necessary to perform functions for 
the operating system. Such processing will typically be 
transparent to agents, clients, knowledge workers and the 
like, but on certain occasions, by need, a chart may be 
displayed while a process is running or for other diagnostic 10 
purpose. 

In general, building modules (objects) contained in a 
programmers tool kit are generic to the basic processes 
being created by the enterprise including standard interface 
and command objects to other resources or C1NOS systems. 15 
These building objects used to program 1PM 287 may be 
provided by the provider of the CINOS system according to 
the general type of business and system architecture used by 
the enterprise. In one embodiment, an enterprise program- 
mer may create the building objects according to desired 20 
enterprise functionality and custom CINOS architecture. 
Therefore, one CINOS system software package may be 
provided specifically for a loan company while another 
CINOS system software package may be provided for an 
investment firm and so on. 25 

Referring now back to FIG. 14, as a programmer defines 
steps and sub -steps as tasks to be performed, he/she is 
setting up the main tasks and sub -tasks that the application 
will perform when executed. In this particular example, task 3Q 
1 is a pre-qualification task for a loan as evidenced by the 
name Pre-Qual in window 291 in the Name column. 

Task 1 comprises 3 sub -tasks, namely sub -task la, sub- 
task lb, and sub -task lc. Sub-task la comprises a module for 
obtaining data from a general credit field such as may be 35 
stored in a database and represented via metadata in the IOM 
described above. Hence, sub-task la would comprise the 
necessary modules or objects for interface with the IOM 
previously described above and for obtaining general credit 
data which may be an enterprise rating system code derived ^ 
from actual credit reports. Additional related data may also 
be accessible in step la a such as a list of creditors, payment 
history, and so on. Step lb provides access to data about 
credit to the enterprise, and step lc provides access to data 
about income such as total monthly income, source of 45 
income, etc. In this way, main task 1 may be completed by 
executing the sub-tasks la-lc. 

In building an IPM such as IPM 287, a goal is to provide 
an interfacing process application that may execute and 
perform an entire business process from start to end accord- 50 
ing to CINOS constraints, time constraints, and enterprise 
rules. Once completed, tested, and fine tuned, an IPM such 
as IPM 287 may be used as a functional model for the 
business process that it represents. 

Column 293 represents a time that each step and sub-step 55 
begins executing within the CINOS system. Numerals illus- 
trated in column 293 represent units of time expired as the 
process is executed. For example, Main task 1 named 
Pre-Qual begins at 0000 (the time that the application is 
invoked). A client who is requesting a loan via telephone or 60 
other media may invoke IPM 287 thus beginning it's auto- 
mated execution while the client waits in queue. In some 
embodiments, wherein a client is not live in queue, an agent 
may initiate the process based on a not-live request such as 
an e-mail or fax. In general the time displayed in windows 65 
under TIME Begin are returns only, based on the actual 
times related and previously required steps are completed. 
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That is, typically a task will not begin at a fixed time from 
0000, but will begin as soon as pre-requisite tasks are all 
completed. 

Windows in column 295 show the time that a step actually 
ends. This is typically a return window as well, and the time 
displayed will be the begin time plus the task elapsed time 
to completion. The programmer typically allots a time for 
each task, and the actual time may be more or less than the 
allotted time. Other actions may be invoked in the case that 
the actual time exceeds the allotted time. 

All sub-steps under a main task typically are allotted time 
increments (according to completion goal) of the allotted 
time for the main task such that the their sum equals the time 
allotted for the main task. The purpose for allotting time 
segments for each task and sub-task is so that efficiency 
improvements may be pursued with regards to client waiting 
and system performance and that interfaces with other 
systems such as routing systems or the like are handled 
smoothly. The time allotments, as described are in effect, 
time goals set by the enterprise. Time modules (not shown) 
are COM tools inserted by the programmer. 

Windows in column 297 represents return fields that 
return actual elapsed times associated with each task and 
sub -task. For example, Main task 1 (Pre-Qual) began at time 
0000. Allotted time for main task 1 is 0010. Main task 1 was 
actually completed at time 0008 or 0002 ahead of schedule. 
As is the case with column 295 (Time End), times in which 
the associated sub -tasks are completed are increments whose 
sum equals the actual time for the main task to obtain 
completion. 

Windows under column 299 contains notification fields 
under the name-field Notify, which is part of title row 289. 
If there are no problems in the execution of a task or sub-task 
then notification is given to go on to the next task or 
sub -task. However, if there are problems in execution such 
as operation time out, or insufficient data for return, then a 
suitable notification-command may be given to the system 
such as return to agent, repeat prior task or sub-task, and so 
on. 

It is important to note here that according to enterprise 
rules, notification may include stopping the process and 
requesting human intervention, allowing more allotted time 
for a task or sub -task to complete and then repeating the task 
or sub -task, or any variety of other options. 

In this example, IPM 287 comprises 4 main tasks of 
which main task 1 has already been described. Main task 2 
is determination of loan type. IPM 287 may comprise tasks 
or sub-tasks that may be executed in parallel under certain 
circumstances. Such is the case with part of main task 2 or 
more specifically sub-task 2a. For example, choices and data 
regarding loan type, amounts of loan, purpose for loan, and 
the like may be held in a separate section or database such 
as product database or the like. Therefore the multi-taskable 
IPM 287 may begin main task 2 upon invocation at time 
0000. However, because a sub-task 26 requires the same 
data obtained with regards to main task 1, it cannot begin 
until main task 1 is complete or at 0008 as indicated in 
column 293. 

A sub-task 2fcl is depended from sub-task 2b and is a data 
sorting operation. An example would be the sorting of assets 
from liabilities. Sub-task 2c allows insertion of data on a 
selected interactive or multimedia loan application in an 
automated fashion. Hence, the first 2 Main tasks and their 
associated sub-tasks pre-qualifies a client and obtains and 
inserts required data into an interactive application. For the 
purpose of this example, there have been no errors or 
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problems with the first 2 main tasks allowing all notifica- 
tions to proceed with the process without human interven- 
tion. 

IPM 287 includes a main task 3 for post qualification and 
data validation. Such a task may be required according to 5 
enterprise rules with a system recommendation to be 
returned regarding weather or not a particular client should 
qualify. It should be noted here that a small amount of time 
elapses between a main task and a first sub-task with regards 
to main tasks 1-3 this is meant by the inventor to show 10 
system preparation time to execute to first sub-tasks. 

Under main task 3, a sub-task 3a validates income. For 
example, a client's income data, instead of being current, 
may be out of date according to a time constraint imposed 
by the enterprise for updating income data in a database. If 15 
this is the case, then a suitable notification may be made to 
the system. The process may be temporarily halted due to the 
notification while an IVR interacts with the client to provide 
more current data. After the client has provided the data, it 
is updated to the IOM and sub -task 3a may be repeated. In 20 
some embodiments, subsequent tasks or sub -tasks in a 
process may be executed while an IVR solicits more data 
from the client provided that they are not critically tied to the 
problem task or sub -task that could not be completed. 

A sub-task 3b validates the applicant's source of income, 
perhaps by accessing a current database containing employ- 
ment records provided by the client's employer. In one 
embodiment, an automated out-dialer may be used to con- 
tact the employer. When connection is made, the call may be 3Q 
transfer to an IVR or a live attendant so that validation may 
be completed. In some cases this will take more than the 
allotted time shown in this example because human inter- 
vention is utilized. In such cases where it is known or 
perceived that human intervention will be required, then 35 
more time will be allotted for the planned purpose. However, 
if the required data is supplied ahead of the loan application 
and stored for access by IPM 287, no human interface will 
be required. 

Similarly, a sub-task 3c may prompt the client via IVR or 4Q 
five attendant for inclusion of any added income such as may 
not be indicated in data storage such as spousal income, an 
additional job-income source, and so on. Such IVR or live 
attendant interaction may be part of the loan procedure with 
appropriate time allotted to complete such procedures and 45 
not specifically the result of a problem or notification. 
Therefore, the amount of human intervention included in a 
business process such as represented by IM 287 may be 
dictated by enterprise rules. 

Asub-task 3d calculates the debt to income ratio and other 50 
required calculations or manipulations of data and then 
makes a system recommendation, based on the calculation 
and enterprise rules, to the agent to which the client will be 
transferred for closing. Hence, the notify field for sub -task 
3d is labeled present. Upon receiving the present 55 
notification, the system forwards the information (completed 
loan application) to an agent ahead of the client's call. An 
interface to the automated routing system enables IPM 287 
to determine which agent will receive the client out of 
queue. 60 

Amain task 4 is simply to display, on an agent's graphical 
user interface (GUI) a completed copy of the loan applica- 
tion associated with the client's identification and incoming 
call. The notification field returns END at task 4 because it 
is the end of the procedure. At this time, a copy of IPM 287 65 
with all of the fields complete may be sent to the program- 
mer or system administrator as indicated on a top row 
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comprising the label field (loan application), Time begin 
field (0000), Time End field (00305), Actual Time field 
(00255), and an update notification option labeled Update. 

In this example, the actual time of 00255 for completing 
a loan application and routing it to an agent is 0005 ahead 
of the allotted time or goal time. The programmer may elect 
to update IPM 287 as the most efficient model yet created 
thereby using it again for subsequent applications, or he may 
elect to fine tune IPM 287 further based on the information 
provided in the returned model. 

Each Interactive Process Module created is adapted to 
operate with a CISNOS operating system according to the 
present invention. As such, each completed module is call- 
able by the OS when needed to perform its programmed 
function. Further, each module is provided with one or more 
inputs to be able to perform its function. In the example of 
qualifying a loan applicant as described above, the required 
inputs will be such as (a) potential borrower's identity, (b) 
type of loan desired, (c) amount of loan requested, and (d) 
payback period requested. Moreover, each module is 
adapted to interact with other CINOS modules. For example 
the loan qualification application described is adapted to 
access other modules, such as the IOM, using the potential 
borrower's ID as a key, to recall information, such as income 
information. Generally speaking, process modules will have, 
then, certain commonalties, such as at least one defining 
input, a task to be performed based on input, and a result to 
be returned, as well as a facility for returning the result. Such 
results may in some cases be Yes/No, a recommendation or 
the like, and may be either displayed for a recipient or used 
as a further input to another Interactive Process Module. 

It will be apparent to one with skill in the art that one IPM 
may be employed for one business process containing 
various secondary alterations to the generic process without 
departing from the spirit and scope of the preset invention. 
For example, a mortgage loan may have differing tasks and 
sub -tasks than an auto loan and so on. However, because 
access to system repositories and resources are similar in 
most loan processes regardless of type or amount of loan, 
modules may be inserted that cover the options. Moreover, 
separate business processes may be run from one IPM as 
long as the required modules are present and operational. 

It will further be apparent to one with skill in the art that 
the present invention may utilize a convention other than 
COM such as by Java applett or the like. 

As previously described, IPM 287 is innovative in part 
because a generic application or model may be used for 
building several differing automated processes, and because 
it breaks down a process into tightly controlled tasks and 
sub -tasks that are executed in concert through interface with 
other CINOS systems. As a result, complicated business 
processes may be executed within CINOS much faster and 
more efficiently than with prior art systems. Furthermore, 
processes may in many instances be wholly automated and 
integrated with system routing and other intelligent services. 

Diverse Interaction Model 

In a preferred embodiment of the present invention, a 
multimedia communication center is provided, as part of 
CINOS, including an interface engine or model that allows 
communication-center interactions resulting from diverse 
interaction paths to be recorded and entered as threaded 
dialog in concert with threaded dialog from more conven- 
tional interactions such as are recorded and entered via 
multimedia threading as described above. 

For the purpose of this specification, a diverse interaction 
path means a non-routine, or less-routine type of commu- 
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nication path that is typically more complicated than a 
conventional interaction path such as a multi-agent confer- 
ence or in-place discussion regarding an enterprise client or 
issue generic to the client. Another example would be 
simultaneous communication between two or more agents 5 
with outside vendors to assist a client who is live and in 
queue. Yet another example would be a multi-client discus- 
sion group organized around a commonly shared issue or 
product It is desired that such dialog or dialogs including 
associated media is made a part of an accessible contact 10 
history wherein the diverse interactions may take their place 
among the more conventional interactions making up a 
customer or issue-specific multimedia thread in a database 
or contact history. 

C1NOS manages traditional interactions according to a 15 
multimedia threading technique taught above wherein vari- 
ous methods, including the use of a live attendant, are used 
to record, parse and enter interaction data into the contact 
history. Such dialog is threaded and associated with actual 
recorded media through use of icons or links whereby, upon 20 
interacting with such links or icons, one may have access to 
actual stored media. However, as interaction paths become 
more diverse and complicated, as in the examples provided 
above, it becomes apparent that added functionality and 
innovation is needed to enable efficient organization and 25 
recording of such data into the contact history so that not 
only are primary dialogs and associated media simple to 
access, but also secondary dialogs and media resulting from 
more diverse interactions. 

Interaction dialogs among second and perhaps third par- 30 
ties involved in a transaction, such as perhaps a contract 
negotiation, may occur simultaneously and, in many 
instances, without inclusion of the primary parties to the 
transaction or negotiation. Therefore, the prospect of logi- 
cally including those dialogs among the primary dialogs on 35 
a client or issue identified thread is more complex. In one 
embodiment of the present invention, such functionality is 
provided via a unique event handler adapted to identify and 
organize such dialogs so that they may be associated along 
the proper thread or threads in a contact history. 40 

FIG. 15 is a block diagram illustrating functionality of an 
exemplary diverse interaction model (DIM) according to the 
present invention, and it's relationship to other elements of 
an operating system such as the CINOS system described 45 
herein. In this particular example DIM 301 is provided as an 
open interface capable of asynchronous interfacing between 
live interactions and other CINOS interfacing engines such 
as the IOM and the IPM described above. In one 
implementation, as a COM model, DIM 301 is a program- 5Q 
mable interface wherein functionality may be installed 
according to specific enterprise rules. 

The example provided herein is meant to represent just 
one possible interaction set that may be tracked, recorded, 
and made a part of a contact history of a communication 55 
center utilizing CINOS. Diverse interactions, as previously 
described in the background section and described with 
examples above, may include virtually any conceivable 
interaction or group of simultaneous interactions that may 
comprise more than a simple one-on-one interaction whether 60 
incoming, out-going, or internal communication using any 
supported media. 

Also, the exemplary DIM of FIG. 15 is shown with a 
number of functional code sets for accomplishing certain 
ends, such as assigning ID to transaction partners and the 65 
like. In FIG. 15 these functions are shown as within the 
boundaries of the DIM. This is not meant to limit the DIM 
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model to having complete code sets as a part of each DIM. 
In reality, such code may be programmed as a part of a DIM 
in some instances, and in other instances the DIM is pro- 
vided with ability to call and use existing code in CINOS. 
CINOS, as described elsewhere in this specification, has, for 
example, functional code for tracking commitments and 
reminding parties to commitments of approaching and 
expired time deadlines. DIM modules may be adapted to call 
this and other such operating code to accomplish purposes of 
the particular DIM. The location of functional code 
examples in FIG. 15 should therefore be taken only to 
represent the existence and use of the code, not whether or 
not the code is resident in the DIM. 

Referring again to FIG. 15 for exemplary purposes, 
assume that a customer 305 who is a subscriber to CINOS 
is engaged in a purchasing process with a communication- 
center agent 1 as illustrated via indicated link 306. Perhaps 
customer 305 is negotiating to purchase a turn-key machine 
shop operation that is being put together as a package by the 
hosting enterprise. There are, in this example, two other 
agents involved in the process. These are agent 2 and agent 
3 as illustrated. In order to provide a complete package to 
customer 305, the enterprise must enlist the cooperation of 
3 outside vendors who will each provide key components of 
the package. These are vendor 1, vendor 2, and vendor 3. For 
the purpose of this example, it will be assumed that vendors 
1-3 are not subscribers to CINOS and are not connected to 
CINOS, although in some embodiments, they may well be 
subscribers connected to a CINOS-driven system. 

A data repository 303 is provided as part of the CINOS 
architecture and is adapted to store multimedia and text- 
based interactions as well as providing an accessible 
threaded history of communication-center dialogs. Reposi- 
tory 303 is analogous to repository 187 of FIG. 7. As such, 
it is logically divided into two sections, one for storing 
threaded dialog, and text-based media (Text-based Data), 
and one for storing recorded multimedia interactions (MIS 
Database) such as may have occurred with respect to enter- 
prise activity. 

As customer 305 converses with agent 1, the conversation 
is being recorded and entered into MIS database while a text 
version is being installed on a dialog thread assigned to the 
customer in the Text-based data section of repository 303, as 
described above. The recording and storing of this simple 
interaction is accomplished as described with respect to 
embodiments presented with reference to see FIG. 7 and the 
text describing FIG. 7 above. However, interactions between 
other involved agents and vendors are important to the 
enterprise in terms of selling the machine shop, and to the 
customer in terms of insuring that every angle is covered 
with respect to his planned purchase. 

DIM 301 allows these additional diverse interactions to be 
recorded and included on the dialog thread belonging to 
customer 305 in repository 303. DIM 301 is adapted, in this 
embodiment, to assign CINOS identification code to each 
outside vendor such as vendors 1-3 as illustrated via a 
function module 309 labeled as Temporary Vendor ID. This 
identification may be accomplished in a variety of ways such 
as perhaps attaching a unique code to a vendor's parameters 
which may include phone numbers e-mail addresses, IP 
addresses, company titles, etc. The identification may be 
temporary, such as for a time period covering a series of 
planned interactions, or permanent depending on enterprise 
rules. In this way, CINOS may track and identify all com- 
munications to or from vendors 1-3. Because agents 1-3 and 
customer 305 are subscribed to CINOS, they have perma- 
nent identification as do all their enterprise interactions. 
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Part of DIM 301 allows for in-place agent collaboration or thread according to any enterprise rule. Interaction sorter 
discussion via function module 307 titled Agent Collabora- 312 may organize the secondary interactions according to 
tion. Function module 307 may be an existing multimedia identification parameters, add a time stamp, and sort accord- 
chat program that may be based in a variety of media such m g to chronological order. If simultaneous interactions are 
as audio, video/audio, or text. Agents 1-3 are illustrated 5 taking place such as was the case in this example, then they 
herein as engaged in collective collaboration via module may be sorte d by involved agent ID and threaded sequen- 
307. An on-screen computer discussion would be a likely ^ally as dialog groups such as all interactions of agent 1, 
venue for such collaboration. followed by all interactions of agent 2, followed by all 

Agents 1-3 in this embodiment are illustrated as being interactions of agent 3, followed by all agent collaboration 

engaged in conversations with vendors 1-3 respectively as 10 j^og 

illustrated via links connecting the agents and the vendors. A . , , . . tl . . , iL , r 

„ , ^ , & . • < The dialogs may be logically inserted on the thread of 

r or example, agent 1 may be conversing with customer 305 . . , . J , , . ... 

- nncT L u-i j m_ j t • nxiT customer 305 via a dialog insert module 314 which is a 

via COST phone, while engaged with vendor 1 via DNT , . . * . . . t t , , 

, / , \ • 4 j-, ! t command uiterface to various data entry systems such as 

phone such that the DNT conversation is not audible to . . , , . 4 , , . . . J f. . , 

* in£ on.- u ji j may be associated with speech to text converters, automated 

customer 305. This may be accomplished via methods c J t . r t . Vl , \ 

. ■ a. _* u * u 1 j u 15 fax systems, e-mail systems or the like. Module 314 may 

known in the art such as a progressive hold button or , 4 ;, t .. „ . . c . „ ' 

jl * ^ • -i i j vu also provide entry paths to hve attendants for latter entry 

switchmg device. Agents 2 and 3 are similarly engaged with ft . • c a .i_ vi 

, % j ^ .-iT.L- * * * a ft er transcription of video or the like, 
vendors 2 and 3 respectively. In this case, agents 1-3 are 

soliciting assurances that vendors 1-3 will have no problems Insert dial °g ue module ™ may, in some embodiments, 

with availability and delivery of their respective parts of the 2Q provide for secondary dialog to be entered on hidden threads 

turnkey package. Perhaps exact parameters are being marked by interactive icons or markers inserted and adapted 

worked out as well such as just-in-time delivery date assur- t0 , reveal the hidden dialog when selected, such as with a 

ances and so on pointer device. In this way, primary agent- customer dialog 

As agents 1-3 obtain required information from vendors m ^ J> e viewed ^tely from intermediate agent-to-agent 

1-3, they are collaborating and sharing the information via ^ collaborative dialog, dialogue with third parties and so on. 

in place discussion through interactive function module 307. Interactive icons may also accompany such dialog for the 

As the agents finish collaborating, agent 1 may relay such of calhn S U P P™ arv ' ecorded dialo S ue * In .^^ 

information as may be desired to customer 305 via COST a svstcm audUor 01 °* her ™**x ma y r ™™ an l ™ oX ™d 

connection and perhaps acquire a purchase order for the ^nsacUon to insure that nothing was missed or overlooked 

machine shop. Hence, a complicated series of interactions 30 by vari0 » s P arties *> the transaction. Also an accurate record 

with multiple parties has transpired in a comparatively short m ^ P nnled °^ *™P™d to settle a future dispute 

period of time in order to aid customer 305 in making a or ^solved issue related to the transaction, 

decisive purchase without ongoing and periodic communi- As an open interface, DIM 301 may be adapted to handle 

cation being necessary over a much longer time. It should be multiple unrelated interactions as they may occur within a 

noted here however, that multiple simultaneous interaction 35 multimedia communication center. In another embodiment, 

as illustrated in the example is not required to invoke the aid separate DIM's may handle separate diverse interactions, 

of DIM 301, or to practice the present invention. The Similarly, there are many possibilities regarding the location 

inventor intends only to show that invoking DIM 301 to aid of a DIM within CIN0S architecture. For example, DIM 

in organizing and threading dialog from the above described 301 may be part of a CINOS manager application such as 

diverse interaction may be beneficial in this instance. The 40 described with reference to server 77 of FIG. 1 (P3313PA). 

exact parameters and functionality of DIM 301 will of Moreover, DIM 301 may be adapted to handle only diverse 

course depend on enterprise rules. interactions as defined by enterprise rules, or may in fact 

Coordinating and threading dialog from the multi-party handle ^ communication center interactions, 

interaction is performed, in this embodiment, via DIM 301 A schedule and reminder module 315 is adapted to notify 

as was previously described and will be further detailed 45 CINOS when an identified party to a transaction must fulfill 

below. Supplied interface modules within DIM 301 provide a promise or scheduled task associated with a transaction or 

command capability to other CINOS routines. One of these negotiation. A universal CINOS data and time function 

modules is an IOM interface 311 that may obtain data from tracks all recorded interactions and ages them accordingly 

the IOM regarding customer 305, vendors 1-3, or other much like a computer operating-system time and date func- 

related data, and relay such data to agents involved in the 50 tion. If a specific interaction involving a scheduled promise 

above described transaction such as agents 1-3. Similarly, approaches deadline, then notification arrangements to the 

an IPM interface 313 may obtain data such as may be responsible party may be made ahead of time. A notification 

processed in conjunction with any automated process that interface module 317 alerts an automated message system 

customer 305 is engaged in and mirror such data to agents which may be part of repository 303, or held separately on 

1-3 as may be required. An example would be perhaps 55 the network, to send notification of the commitment to 

mirroring data processed by an IPM handling the customer's involved parties. 

overseas shipping information or the like. The DIM described above is illustrated according to a 
Because each participant to the dialog is identified, and all particular diverse interaction situation involving a customer 
of the interactions are identified, they may be time-stamped and multiple agents and vendors. A multitude of differing 
and organized according to such identification or identifi- 60 interaction paths may, however, be supported and enhanced, 
cations by an interaction sorter module 312. Agent 1 and For example, a DIM may be programmed in a manner that 
customer 305 may, in some embodiments, maintain priority customers purchasing particular product may be automati- 
on the thread in which the turnkey purchase dialog is a part. cally logged into a discussion group existing for the purpose 
However, because the threaded dialog supports multimedia, of interactive technical support among customers. In this 
and may accept additional information, secondary dialog 65 example, the discussion group can be a WEB -based chat- 
resulting from agents during collaboration and agents to room, a video-conferencing facility, or may support any 
respective vendors may be inserted onto the customer's other medium supported by the CI OS system. In addition to 
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allowing the customers to interact through the MMCC, 
many enhancements may be provided specifically to such a 
group, such as database access to technical information and 
the like pertinent to the particular product 

As another example, outside businesses, such as vendors 
and the like, identified in the CINOS system may interact 
with one another for defined purposes through a customized 
DIM in CINOS. In this case, vendors 1 and 2 in FIG. 15 may 
have an interdependency in supplying parts or services for a 
CINOS-managed process or project. A DIM may be set up 
quickly and easily allowing the two vendors to cooperate 
and to access certain information in the enterprise data 
repositories related to the defined purpose of the DIM and 
the project. 

It will be apparent to one with skill in the art that a D IM 
such^as uim 3U1 may comprise ad ditional or fewer 
modules, or module s of a dilt'ering tunctionthan the opes 
il lustrated herein wi thuUl depailiim fium fcfae-sprrifana*sc ope 
of lthe present invention. For example, additional inte rface 
modules may be added and adapted to interface with o ther 
CINOS routi nes such as routing functions or otfter auto- 
mated s ervices. It wall also be apparent to the skilled artisan 
t hat vendors supplying the en t erprise witti products destin ed 
fo r customers may or may not be utilizing CIJNUS sysje ms 
without departing ir om tne s pirit and scope of the pres ent 
i nvention. For example, vendors 1-3, in this example, may 
r ecei ve^ autom a ted and scheduled poti fica ^on for lust- in- 
tinie^eiiv ery or the like via notificationT nterfa^ 317 if it is 
op erationally interlaced with a LINUS out-bound out -d ialer 
app lication. 

It should also be apparent to one with skill in the art that 
CINOS interpretation of a diverse interaction as opposed to 
a conventional interaction may be programmed according to 
enterprise rules without departing from the spirit and scope 
of the present invention. For example, a one-on-one inter- 
action of any media type may be considered by an enterprise 
to be a conventional interaction with the dialog entered as 
such while the addition of multiparty side discussions may 
be considered a diverse interaction associated with the 
conventional interaction thus invoking a DIM such as DIM 
301, and so on. 

Invocation or initiation of a DIM such as DIM 301 may 
occur at the planned beginning of such interactions, or at 
such time that a conventional interaction may become a 
diverse interaction with the addition of, perhaps more than 
one party to the interaction. In one embodiment, a transac- 
tion monitor or monitors such as are known in the art may 
be used to identify the number of parties in an interaction, 
or perhaps the type of interaction based on enterprise rules, 
and be adapted to notify a DIM such as DIM 301. 

In one embodiment, CINOS may be shared by distinctly 
separate organizations who must collaborate and provide 
infrastructure in order to complete a vast project or mission 
such as perhaps building and launching a space station. 
Many specialized groups involved in such a process may 
hold diverse interactions comprising multiparty discussions, 
interactive seminars, cost accounting meetings, or other like 
collaboration without physically gathering to hold such 
meetings. Such implementations may be largely temporary 
and customized according to requirement. A DIM in this 
case would be responsible for identifying and providing 
instruction for entering and threading such dialog resulting 
from the multiparty interactions iDto a central repository 
shared by all participating organizations. 

Specialized Threaded-Dialog Model 

According to a preferred embodiment of the present 
invention a unique programmable event handler is provided, 
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termed a specialized threading model (STM) by the inven- 
tor. In addition to logically inserting dialog from diverse 
interaction paths to associated customer threads and the like 
as described with reference to the section entitled Diverse 

5 Interaction Model, it is also desirable to create special 
threads (associations) derived from stored and real-time data 
records, which may be used for temporary or ongoing 
research. Therefore, an STM is provided as a 
programmable-interface application which allows a 
0 researcher to find and study information shared within and 
through CINOS according to very specialized criteria. 

The term Model as presented herein and associated with 
other COM -based interface engines or applications such as 
the above described IOM, DIM, and IPM, is used to describe 

15 COM-based software models wherein functional software 
modules and/or objects may be installed in order to create 
the larger functional software module which is called in the 
art a COM model. It will be apparent to the skilled artisan 
that functional modules, as will be illustrated as located 

2Q within an STM as taught below, are not limited to residing 
within the described model, but in many instances, may be 
existing code-sets or routines generic to CINOS and resident 
in other parts of interfacing software. These code-sets or 
routines may be initiated or invoked by a module from 

25 within the described model as will be further explained 
below. It will also be apparent that the COM-object imple- 
mentation is exemplary, and other programming techniques 
may be used within the spirit and scope of the invention. 
FIG. 16 is a block diagram illustrating an exemplary 

30 Specialized Threading Model 319 according to an embodi- 
ment of the present invention. Model (STM) 319 is provided 
as a programmable tool (software application) operable in 
CINOS that may be invoked and used by a researcher or 
other authority for the purpose of conducting specialized 

35 research by associating stored and real-time data. A 
researcher 320 may execute a programmed STM from a 
PC/VDU such as PC/VDU 322, as illustrated via expansion 
arrows emanating from PC 322. 
A communication-center data-repository 321 is provided 

40 for the purpose of warehousing data and is analogous to 
previously-described repositories such as repository 303 of 
FIG. 15, Repository 321 is logically divided in many pre- 
ferred embodiments into two sections for data storage. One 
section (Text-Based Data) contains all of the communication 

45 center's threaded-interaction dialog and text media. The 
other section (MIS Database) contains all of the recorded 
multimedia associated with the dialog stored in the text- 
based section. It will be apparent to one with skill in the art 
that there may be additional repositories or databases held in 

50 separate locations on the CINOS network without departing 
from the spirit and scope of the present invention. The 
inventor chooses to illustrate only one such repository for 
the purpose of simplifying explanation. Also indices to or 
abstracts of such databases may be used, rather than data- 

55 bases themselves. 

STM 319 may access stored text data from repository 321 
(Text- Based Data section), stored multimedia data from 
repository 321 (MIS Database) and, in some cases, live text 
or multimedia data such as may be occurring during live 

60 interaction in a multimedia call center. Such live interactions 
as described and illustrated in this embodiment include 
interaction 329 which is a chat room having four customers 
engaged in interactive communication, for example, in dia- 
log concerning a mutually purchased product (iotemal- 

65 hosted by the enterprise). An interaction 323 is illustrated 
and involves a customer and an agent wherein, for example, 
the customer has initiated the interaction (incoming). An 
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interaction 325 is illustrated and involves two outside ven- 
dors wherein, for example, the vendors are subscribed to 
CINOS and discussing details of a joint just-in-time (JIT) 
shipment to the enterprise (external). An interaction 327 is 
illustrated and involves an agent and a customer (labeled as 5 
such) wherein, for example, the agent has initiated the 
interaction (out bound). 

Hereinafter, the live interactions illustrated will be iden- 
tified by the interaction type and the element number. For 
example, interaction 329 will be referred to as internal 10 
interaction 329. Interactions 323, 325, and 327 will be 
referred to as incoming interaction 323, external interaction 
325, and out-bound interaction 327 respectively. The inter- 
actions described above are all live and occurring during the 
run-time of STM 319. All live interactions illustrated herein 15 
are entered into repository 321 as illustrated via directional 
arrows emanating from each interaction in a direction 
toward repository 321. These stored interactions as the 
real-time interactions are terminated become part of the 
stored database along with all previously stored interactions 20 
and annotated and text versions of such interactions. 

As previously described, STM 319 may, through a moni- 
toring process described in more detail below, access live 
data (dialog) and utilize such data at the time the data is 
created, or more specifically, before or at the same time that 25 
such data is either entered into (text) or recorded into 
(multimedia) repository 321. In this way, a unique and 
innovative method is created whereby dialog associations 
may be created from stored data with additional dialogs 
being added to the association in real-time as they occur with 30 
respect to live interactions such as those illustrated in this 
example. Such a process may be executed via STM 319 and 
run in the background on a PC/VDU such as PC/VDU 322 
being used by researcher 320 while other work is being 
performed. Similarly, STM 319 may reside in repository 321 35 
instead of PC/VDU 322 when not in use as illustrated via 
expansion arrows emanating from repository 321. That is, 
the functionality may be client-server based. In this case, a 
CINOS-connected agent may invoke STM 319 remotely via 
PC such as PC/VDU 322. 40 

Referring back to FIG. 16, STM 319 is different from the 
diverse interaction model (DIM) 301 as described with 
reference to FIG. 15 in that it is expressly dedicated to 
creating new associations or dialog threads from those 45 
already created (and from live interaction) based on implicit 
instruction from a programmer which may be a knowledge 
worker, agent, researcher, or any other authorized indi- 
vidual. Such associations may be stored in repository 321 
and displayed on a PC/VDU such as PC/VDU 322. 5Q 

STM 319 may be created in a generic COM container that 
is provided along with insertable modules in the form of a 
desk-top or server-based tool-kit accessible to researcher 
320. Once created, an STM such as STM 319 may be 
modified through editing for the purpose of performing 55 
another task which may differ from the original task. Several 
STM's such as STM 319 may be created for different 
research projects and be run simultaneously within CINOS 
and share the same data and interfaces in an asynchronous 
multi-tasking environment such as is attributed to CINOS 60 
routines. 

In the example provided herein, STM 319 comprises 
insertable modules that are dedicated to performing certain 
functions or interfacing with and invoking certain physically 
separated functions or routines that are generic to CINOS. 65 
For example, a search function module 330 is provided and 
adapted to searching stored data for pre-defined key- words 
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or phrases similar to the operation of known search func- 
tions or search-engines used on the Internet or by other data 
functions. Again, this function may be wholly within Model 
319 in some embodiments, and Model 319 may call the 
search function from CINOS in other embodiments. 

Search function 330 accepts input parameters entered by 
researcher 320 such as a word, word association, phrase, 
Model number, and the like designed to associate otherwise 
unrelated dialogs. Additional input parameters that may be 
entered to search function 330 include limits or constraints 
associated with the type of and area of data to be searched. 
For example, if a desired keyword association-parameter is 
"disk-drive, problem, install", and the search area-parameter 
is customer history database, then search function 330 will 
look for all dialogs containing the words disk-drive, 
problem, and install that are stored in the customer history 
database. 

Because threaded dialogs that may be stored in a multi- 
media communications center operating CINOS have mark- 
ers or icons associating those dialogs to the actual stored 
media as previously described under the section entitled 
Rules-Based Storage and Threading of Multimedia 
Interactions, search function 330 may be uniquely adapted 
to identifying these media icons and associating them with 
the specific dialogs for latter interaction. 

An interaction monitor module 331 is adapted to com- 
municate with and send commands to various transaction 
monitors (not shown) that may be installed and operating 
within the CINOS operating system and adapted for moni- 
toring live or recent interactions or transactions of various 
media types. For example, one transaction monitor may be 
assigned to monitor incoming COST calls, while another 
transaction monitor may be assigned to monitoring DNT 
interactions such as IP phone calls. Monitors may also be 
adapted to monitoring voice mails and other types of 
recorded voice messages. Furthermore, text-based monitors 
or text analyzers may be adapted to read and parse text- 
based messages such as e-mails, faxes, internal memos, or 
any other text documents that may be made into digital files. 
In this way, interaction monitor module 331 may utilize the 
same input parameters assigned to search function module 
330 thereby extending it's functionality via command to 
such monitors and text analyzers assigned to live interac- 
tions as well as recent not-live text transactions that have yet 
to be entered into a repository such as repository 321. 

To illustrate one example of the method described above, 
suppose that researcher 320 has programmed one key phrase 
"having a problem with" into search function 330 and 
programs interaction monitor module 331 to interface the 
parameters via command to a monitor charged with moni- 
toring incoming COST calls. Upon initiation of STM 319, 
function 330 will search stored data for the key phrase while 
module 331 will instruct the incoming COST monitor to 
alert the researcher if the key phrase is detected during a live 
COST interaction. The scope of live interaction and recent 
transaction monitoring with regards to parameters set by 
researcher 320 may vary according to the purpose of STM 
319. The advantage of the above stated ability will be more 
apparent through further description provided below. 

An IOM interface module 333 gives researcher 320 an 
option to access an abstraction of hard data or metadata 
instead of accessing actual hard data from repository 321 as 
discussed with reference to the section entitled Stored- 
Media Interface Engine (Interaction Object Model). A noti- 
fication interface module 335 provides notification in the 
form of an audible alert, pop -up window, or even an elec- 
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tronic page or other form of alert associated with events that 
may occur during execution of STM 319 that may be of 
express interest to researcher 320. Such an alert or notifi- 
cation may occur if, for example, a period for running STM 
319 is nearing expiration, or perhaps if a required monitor 5 
far live interaction is not on-line. Notification interface 335 
may simply notify when a new dialog is added to an 
association of dialogs, and so on. Module 335 may also be 
programmed to alert multiple parties or a single party of the 
occurrence of any notable events that may take place during 10 
the execution of STM 319. 

A thread builder module 337 is an engine that creates a 
new thread or threads according to the parameters entered 
with respect to modules 330 and 331. For example, dialogs 
found by module 330, that contain the input parameter 15 
key-word, word association, or phrase are arranged and 
associated in a way that is logical to researcher 320 and in 
accordance with entered input criteria. A dialog sorter mod- 
ule 339 is provided to assist module 337 in this function, 
although in some embodiments, one module may be created 20 
for both functions. Dialog sorter module 339 may accept 
certain parameters for the purpose of organizing many 
separate unrelated dialogs according to programmed rules. 
That is, in addition to being associated by the search 
parameter, dialogs may be further organized by other input 25 
criteria. 

In one embodiment, dialog sorter module 339 recognizes 
the time and date stamp for each dialog and organizes the 
dialogs adhering to that order. Thread builder 337 then 
creates an abstract thread or tree -structure associating the 30 
dialogs using interactive media icons and stores the new 
thread (association) in an unused section of repository 321 
where it may be later accessed. In another embodiment, 
researcher 320 may enter overriding input parameters 
related to dialog sorter 339 that may negate or override 35 
existing time and date stamps for a more preferable sorting 
criteria such as a sort by media association, sort according 
to original thread identification, and so on. 

An interface command module 341 may be installe d for ^ 
t he purpose of accomplishing an interface to other CI NOS- 
systems such as routing, messaging, out-dialing,^a ujomated 
services, and so on-tAdis^ la ^function module 343~allows an 
i nteract^ oic fure oi''j:ne newiv crea ted bread' as organized 
krtd rWi via modules ,339 and 337, to b'e displaced orT a 45 
PC/VDU such as the researcher's PC _322\ Th e display ma y, 
"i n one embodiment, appear as an ac tual t ree or jhre ad 
conne cting various interactive icons repre senti ng dialog and 
associat ed bard media. In a nother embodunen^t he displ ay 
may De a simple list or. inter active te xu^iles/nie nature of 5Q 
interaction with the u'ispJa l ^s™such that manipulating the 
interactive icons with a pointer device, or by entering certain 
keyboard commands, full text and hard media may be 
accessed and viewed by researcher 320 from PC 322. 

A hard-media viewing module 345 comprises the neces- 55 
sary viewers for accessing and displaying various media 
types that may be represented by dialogs and supported 
within the communication center. Module 345 may, instead 
of containing actual viewers, simply contain command 
modules that invoke appropriate viewers installed on PC 322 60 
or otherwise accessible by the PC. Such automated execu- 
tion modules as module 345 enable the appropriate media 
viewer to be invoked without requiring manual initiation via 
PC 322. 

A closing function module terminates execution of STM 65 
319 according to parameters entered by researcher 320. An 
example of a closing parameter might be to terminate after 
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a given period of time such as one work period. Other 
parameters may be entered as well such as terminate when 
a goal number of target dialogs is reached and constructed 
on a thread, and so on. Along with termination of STM 319, 
created threads or associations may also be terminated or not 
depending on input parameters. For example, time may be 
desired after a specialized thread is created for study pur- 
poses after STM 319 has terminated it's operation. In this 
case, perhaps a certain time period allotted for study will 
elapse before the thread is erased or purged from repository 
321. In some cases, the specialized thread may be perma- 
nently stored for review. 

It should be apparent to one with skill in the art that the 
modules represented with respect to STM 319 are only 
exemplary of the types of modules that may be used in 
creating STM 319. There may be more or fewer modules of 
different function and order without departing from the spirit 
and scope of the present invention. Moreover, such modules 
may be executable routines within STM 319, or simply 
command modules that notify and execute physically sepa- 
rate routines such as call monitoring routines or the like. In 
most embodiments a combination of resident modules and 
command modules may be used. 

The advantages of STM 319 are that specialized research 
or study may be conducted by an agent, knowledge worker, 
or researcher for practically any type of issue or problem 
relating to enterprise activity. For example, an STM such as 
STM 319 may be used to obtain information related to the 
success or failure of newly introduced products, perhaps 
pointing to or indicating changes or revisions that may be 
desired by customers owning the products. STM 319 may be 
used to gage success of a temporary promotion or adver- 
tisement by creating a specialized thread containing dialogs 
of all interactions about the promotion or advertisement 
taking place since such time that the promotion or adver- 
tisement was launched. 

The unique capability of STM 319 to access or intercept 
live interactions allows agents or researchers to monitor 
most recent dialogs associated with a subject of research. 
This innovative technique is especially usefiil in a fast-paced 
sales organization wherein many different products are sold 
over a network. A researcher may chose one product as a 
subject for an STM such as STM 319. By running the 
application in the background, he/she may actively obtain all 
incoming dialogs related to purchasing that product with 
such dialogs appearing on a specialized thread in order of 
occurrence. By programrning interaction monitor module 
331 with desired parameters, he/she may choose the type or 
types of supported media from which to select or search 
dialogs from. 

Live interaction may be searched or parsed according to 
search parameters regardless of interaction type and media. 
For example, internal interaction 329, which in this embodi- 
ment is an open chat room, may be parsed for any dialogs 
relating to the search subject entered as a parameter to search 
function 330. Incoming, out bound, and external communi- 
cations in any supported media may be monitored and 
parsed for search parameters. External communication such 
as vendor to vendor as illustrated via external interaction 
325 may be monitored by CINOS in the event that they are 
connected to the CINOS network, which in this case may be 
a network operating system shared by a group of separate 
organizations. 

In the case of transcription of a media type as may be 
performed by a live attendant, STM 319 may notify the 
attendant which may, for example, send the newly created 
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transcript to a text analyzer being commanded via STM 319. an access function t hat accesses at least stored data in the 

The transcript dialog may then be parsed and associated <r- "ci ata repository ; 

accordingly. a se arch func tion that searches accessed data for associa- 

It will be apparent to one with skill in the art that an STM "tlcm criteria, and note s those datTenEties that me et the 

such as STM 319 may be created to perform a wide variety 5 -a sso ciation crite r ia; an t F 

of research tasks without departing from the spirit and scope ,.-=^ — r : — - ,. . . . ,. - , 

of the present invention. For example, an STM may be a dls P la y ^ cil0n Splays at least indicators of data 

created to associate dialogs related to a fix to a technical „ entlties meeUn g ^ association cntena 

problem as may be discussed among customers, agents, 2. The applicaUon of claim 1 wherein the display funcUon 

technicians, or the like in chat rooms, via COST interactions, 1Q displays icons for data entities, the icons arranged in threads 

DNT interactions or any other supported media. or tree structures. 

In one embodiment, an STM such as STM 319 may be 3 The application of claim 2 wherein the icons are 

used as a motivational tool for sales agents or the like. For interactive icons that, being selected, invoke and render the 

example, by searching dialogs from agent/customer inter- data associated with the icon. 

actions for certain scripted phrases designed by the enter- 4. The application of claim 1 wherein the associa tion 

prise for improving customer relations or perhaps triggering 15 criteria comprises individual and combination s of key 

a sale, one may determine how often or to what extent these words, phrases, t ext strings, date of occurrence, J une of 

phrases are actually being used by which agents and so on. occurre nce, media type, participant characteristics, duratio n 

By comparing such accounts to the agents personal sales or interac tin g and participant jnitiat'nn 

records, one may obtain an indication of which phrases are 5. The application of claim 1 wherein the access function 

more successful and so on. 20 allows access to stored data and also an ability to monitor 

Specialized threads created by STM 319 may aid the transactions occurring in real time, 

enterprise in such areas as improving service, increasing 6. The application of claim 5 wherein the real time 

sales, streamlining operations, improving customer service, transactions comprise connection -oriented switched tele- 

planning future manufacturing, or any other conceivable phony (COST) calls, data network telephony (DNT) calls, 

enterprise endeavor. including Internet Protocol (IP) calls, facsimiles, e-mails, 

It will be apparent to one with skill in the art that one STM voice mails, and WEB document interactions, 

such as STM 319 may be programmed to search according 7 - The application of claim 1 further comprising a pro- 

to any constraints with respect to media type, area of search, grammable alert function that alerts one or more of persons 

length of time allotted for ongoing dialog association, and so 3Q associated with the MMCC according to programmed alert 

on, without departing from the spirit and scope of the present criteria. 

invention. For example, one STM may search repository 321 8. In a multimedia call center (MMCQ supporting mul- 
and only incoming e-mails and faxes, whereas another STM tiplc channels and forms of communication and storing call 
may be dedicated to obtaining dialog from incoming live center transactions in a data repository, a method for con- 
interaction but not dialog history as may be stored in 35 ducting data research, comprising steps of: 
repository 321 and so on. Also, rather than just basic (a) determining association criteria for relating data enti- 
searches encompassing keywords etc., natural language or at ties according to a research need; 
their emergence, multimedia search engines may be used, (b) accessing the data repository to search stored data for 
that compare a concept to recorded voice, video etc. There conformance to the determined association criteria; 
are many variant possibilities, many of which will depend ^ ( c ) searching the accessed data entities for match to the 
upon the type of enterprise and supported media. association criteria; and 

It will be apparent to one with skill in the art that CINOS (d) dis pi ayin g indicators of data entities that match the 

may be implemented in a single communication center, or in association criteria 

a plurality of communication centers linked via WAN with- 9 ^ melhod of claim 8 wherein ^ step (d) the display 

out departing from the spirit and scope of the present 45 faction displays icons for data entities, the icons arranged 

invention. in tnreads or tree structures. 

It will also be apparent to one with skill in the art that rules 10. The method of claim 9 wherein in step (d) the icons 
may be created which govern access to CINOS without displayed are interactive icons that, being selected, invoke 
departing from the spirit and scope of the present invention. and ren der the data associated with the icon. 
For example, customers may be required to subscribe to 50 n. The method of claim 8 wherein in step (a) the 
CINOS, and may also be provided with a customer appli- association criteria comprises individual and combinations 
cation enabling such access. In another embodiment, access 0 f k e y words, phrases, text strings, date of occurrence, time 
may be given to the general public according to established 0 f occurrence, media type, participant characteristics, dura- 
security rules governing commerce, financial transactions, uon 0 f interaction, and participant initiation, 
and other processes. S5 12. The method of claim 8 wherein in step (b) the access 

There are many existing and future implementation function allows access to stored data and also an ability to 

opportunities for an interaction operating system such as monitor transactions occurring in real time. 

CINOS many of which have already been stated. The spirit 13. The method of claim 12 wherein in step (b) the real 

and scope of the present invention is limited only by the time transactions comprise connection-oriented switched 

claim that follow. 60 telephony (COST) calls, data network telephony (DNT) 

What is claimed is: calls, including Internet Protocol (IP) calls, facsimiles, 

1. In a multimedia call center (MMCC) supporting mul- e-mails, voice mails, and WEB document interactions, 

tiple channels and forms of communication and storing call 14. The method of claim 8 further comprising a step for 

center transactions in a data repository, a threading software alerting one or more of persons associated with the MMCC 

application, comprising: 65 according to programmed alert criteria. 

a programming input for a user to entgr assoc iation 

cntena; * * * * * 
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